2023-08-25T09:24:09.835 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T09:24:09.836 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --name rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318/orig.config.yaml 2023-08-25T09:24:09.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T09:24:09.975 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318 branch: wip-rishabh-2023aug3-b5 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: null first_in_suite: false job_id: '7379318' kernel: client: branch: testing flavor: default kdb: true sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-2023aug3-b5 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: test-nfs-pr-52556 sha1: 4b369cf18ed1391a426ab4ae86da834e9c074f81 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 sleep_before_teardown: 0 suite: fs suite_branch: test-nfs-pr-52556 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_4b369cf18ed1391a426ab4ae86da834e9c074f81/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 4b369cf18ed1391a426ab4ae86da834e9c074f81 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcRDpPGn5lf9rB22obTXJ0un+eDrFn9qE5/Eda1K5OZmjx9TllosIHLNlyvFkzZKyuY3ejIQQJNO5HbWhmPAj8= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKs2YmSHlPXN15JCmQOohZcsXPH8esRfUYpX9m8oY+HazBV37eEHUCZAumOBxxNUJ/KENJ5Th0y2bTpflK4mfjM= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeJnt5MoAMFJQCisA3+O5+BC50e/or24bn0+QgPGFX33HcVpD3YBwvE8CZcV0kcgYhQ1cvz1za+KCrgSk5ap8s= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-25_06:38:25 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-25T09:24:09.976 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_4b369cf18ed1391a426ab4ae86da834e9c074f81/qa; will attempt to use it 2023-08-25T09:24:09.977 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_4b369cf18ed1391a426ab4ae86da834e9c074f81/qa/tasks 2023-08-25T09:24:09.978 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-25T09:24:09.980 INFO:teuthology.task.internal:Checking packages... 2023-08-25T09:24:10.010 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ba6b39e4f4f77fb95c747099b53db0467d435f56' 2023-08-25T09:24:10.010 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-25T09:24:10.011 INFO:teuthology.packaging:ref: None 2023-08-25T09:24:10.011 INFO:teuthology.packaging:tag: None 2023-08-25T09:24:10.011 INFO:teuthology.packaging:branch: wip-rishabh-2023aug3-b5 2023-08-25T09:24:10.011 INFO:teuthology.packaging:sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:24:10.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-2023aug3-b5 2023-08-25T09:24:10.229 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5703.gba6b39e4 2023-08-25T09:24:10.229 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-25T09:24:10.235 INFO:teuthology.task.internal:no buildpackages task found 2023-08-25T09:24:10.235 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-25T09:24:10.247 INFO:teuthology.task.internal:Saving configuration 2023-08-25T09:24:10.264 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-25T09:24:10.269 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T09:24:10.295 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 09:19:08.168876', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcRDpPGn5lf9rB22obTXJ0un+eDrFn9qE5/Eda1K5OZmjx9TllosIHLNlyvFkzZKyuY3ejIQQJNO5HbWhmPAj8='} 2023-08-25T09:24:10.322 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 09:19:08.170412', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKs2YmSHlPXN15JCmQOohZcsXPH8esRfUYpX9m8oY+HazBV37eEHUCZAumOBxxNUJ/KENJ5Th0y2bTpflK4mfjM='} 2023-08-25T09:24:10.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 09:19:08.171850', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeJnt5MoAMFJQCisA3+O5+BC50e/or24bn0+QgPGFX33HcVpD3YBwvE8CZcV0kcgYhQ1cvz1za+KCrgSk5ap8s='} 2023-08-25T09:24:10.343 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-25T09:24:10.349 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-08-25T09:24:10.349 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-08-25T09:24:10.349 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['client.0'] 2023-08-25T09:24:10.350 INFO:teuthology.run_tasks:Running task console_log... 2023-08-25T09:24:10.455 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7391bbd30>, signals=[15]) 2023-08-25T09:24:10.457 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-25T09:24:10.462 INFO:teuthology.task.internal:Opening connections... 2023-08-25T09:24:10.463 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-08-25T09:24:10.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:24:10.548 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2023-08-25T09:24:10.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:24:10.631 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-08-25T09:24:10.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:24:10.713 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-25T09:24:10.720 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-08-25T09:24:10.738 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-08-25T09:24:10.739 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-25T09:24:10.796 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-25T09:24:10.796 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-08-25T09:24:10.796 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-25T09:24:10.796 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:24:10.796 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-08-25T09:24:10.797 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:24:10.797 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:24:10.797 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-25T09:24:10.797 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:24:10.797 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:24:10.798 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:24:10.798 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:24:10.798 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:24:10.798 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:24:10.799 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-25T09:24:10.825 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-08-25T09:24:10.844 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-08-25T09:24:10.844 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-08-25T09:24:10.900 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-08-25T09:24:10.900 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2023-08-25T09:24:10.901 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-08-25T09:24:10.901 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:24:10.901 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2023-08-25T09:24:10.901 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:24:10.901 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:24:10.901 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-08-25T09:24:10.902 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:24:10.902 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:24:10.902 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:24:10.902 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:24:10.903 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:24:10.903 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:24:10.903 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-08-25T09:24:10.926 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-08-25T09:24:10.944 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-08-25T09:24:10.944 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-08-25T09:24:11.001 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-08-25T09:24:11.001 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2023-08-25T09:24:11.001 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2023-08-25T09:24:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-25T09:24:11.003 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-08-25T09:24:11.003 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T09:24:11.003 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-25T09:24:11.003 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T09:24:11.003 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-08-25T09:24:11.025 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-25T09:24:11.035 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-25T09:24:11.042 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-25T09:24:11.043 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-08-25T09:24:11.045 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2023-08-25T09:24:11.047 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-08-25T09:24:11.062 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-25T09:24:11.068 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-25T09:24:11.068 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-08-25T09:24:11.102 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2023-08-25T09:24:11.104 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-08-25T09:24:11.201 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-25T09:24:11.278 INFO:teuthology.run_tasks:Running task kernel... 2023-08-25T09:24:11.293 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'} 2023-08-25T09:24:11.294 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-08-25T09:24:11.294 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-08-25T09:24:11.294 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T09:24:11.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:24:11.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-08-25T09:24:11.486 DEBUG:teuthology.task.kernel:sha1 for client.0 is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T09:24:11.486 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-25T09:24:11.487 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-08-25T09:24:11.503 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-239.el9.x86_64 2023-08-25T09:24:11.503 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-239.el9.x86_64 vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T09:24:11.504 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-25T09:24:11.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum upgrade -y linux-firmware 2023-08-25T09:24:13.654 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 9.0 MB/s | 6.2 MB 00:00 2023-08-25T09:24:14.954 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2023-08-25T09:24:15.869 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.8 MB 00:00 2023-08-25T09:24:18.731 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 18 MB 00:01 2023-08-25T09:24:22.289 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 14 kB 00:00 2023-08-25T09:24:23.081 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 26 MB/s | 18 MB 00:00 2023-08-25T09:24:29.051 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-08-25T09:24:29.057 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-08-25T09:24:29.057 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-08-25T09:24:29.057 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-08-25T09:24:29.057 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-08-25T09:24:29.058 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware noarch 20230814-139.el9 CentOS-BaseOS 307 M 2023-08-25T09:24:29.058 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:24:29.058 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-08-25T09:24:29.058 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-08-25T09:24:29.058 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 1 Package 2023-08-25T09:24:29.059 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:24:29.059 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 307 M 2023-08-25T09:24:29.059 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-08-25T09:24:36.998 INFO:teuthology.orchestra.run.smithi149.stdout:linux-firmware-20230814-139.el9.noarch.rpm 39 MB/s | 307 MB 00:07 2023-08-25T09:24:36.999 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-08-25T09:24:37.000 INFO:teuthology.orchestra.run.smithi149.stdout:Total 39 MB/s | 307 MB 00:07 2023-08-25T09:24:37.000 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-08-25T09:24:37.081 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-08-25T09:24:37.082 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-08-25T09:24:39.073 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-08-25T09:24:39.074 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-08-25T09:24:45.142 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-08-25T09:24:45.824 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : linux-firmware-20230814-139.el9.noarch 1/2 2023-08-25T09:24:45.904 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-25T09:24:47.422 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: linux-firmware-20221214-129.el9.noarch 2/2 2023-08-25T09:24:47.423 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 1/2 2023-08-25T09:24:47.825 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : linux-firmware-20221214-129.el9.noarch 2/2 2023-08-25T09:24:47.825 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:24:47.825 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-08-25T09:24:47.826 INFO:teuthology.orchestra.run.smithi149.stdout: linux-firmware-20230814-139.el9.noarch 2023-08-25T09:24:47.826 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:24:47.826 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-08-25T09:24:48.133 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.0... 2023-08-25T09:24:48.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T09:24:48.280 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/9/flavors/default/x86_64/ 2023-08-25T09:24:48.280 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/9/flavors/default/x86_64/ --input-file=- 2023-08-25T09:24:48.282 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2023-08-25T09:24:59.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-08-25 09:24:59 URL:https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/9/flavors/default/x86_64/kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm [319273036/319273036] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-25T09:24:59.148 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2023-08-25 09:24:59-- 2023-08-25T09:24:59.148 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 11s 2023-08-25T09:24:59.148 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 304M in 11s (28.9 MB/s) 2023-08-25T09:24:59.149 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.0... 2023-08-25T09:24:59.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-25T09:25:00.990 INFO:teuthology.orchestra.run.smithi149.stdout:Verifying... ######################################## 2023-08-25T09:25:01.031 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing... ######################################## 2023-08-25T09:25:01.080 INFO:teuthology.orchestra.run.smithi149.stdout:Updating / installing... 2023-08-25T09:25:08.267 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-6.5.0_rc7_ga6a696707610-1 ######################################## 2023-08-25T09:25:46.358 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-25T09:25:46.359 DEBUG:teuthology.orchestra.run.smithi149:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-25T09:25:46.440 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.440 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/config-6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.440 INFO:teuthology.orchestra.run.smithi149.stdout:/boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.440 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-25T09:25:46.441 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-25T09:25:46.442 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-25T09:25:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-25T09:25:46.444 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-25T09:25:46.445 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-25T09:25:46.446 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-25T09:25:46.447 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-25T09:25:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-25T09:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-25T09:25:46.450 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-25T09:25:46.451 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/custom_method.ko 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-25T09:25:46.452 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ata_generic.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-25T09:25:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-25T09:25:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-25T09:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-25T09:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-25T09:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sis.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-25T09:25:46.458 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-25T09:25:46.459 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay 2023-08-25T09:25:46.460 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block 2023-08-25T09:25:46.461 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/brd.ko 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/loop.ko 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx 2023-08-25T09:25:46.462 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/virtio_blk.ko 2023-08-25T09:25:46.463 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkfront.ko 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random 2023-08-25T09:25:46.464 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-25T09:25:46.465 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-25T09:25:46.466 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-25T09:25:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/uv_mmtimer.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/virtio_console.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-25T09:25:46.468 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat 2023-08-25T09:25:46.469 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-25T09:25:46.470 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-25T09:25:46.471 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-25T09:25:46.472 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-25T09:25:46.473 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/edd.ko 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid 2023-08-25T09:25:46.474 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-25T09:25:46.475 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-25T09:25:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-25T09:25:46.477 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-25T09:25:46.478 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-25T09:25:46.479 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-25T09:25:46.480 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-25T09:25:46.481 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-25T09:25:46.482 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-25T09:25:46.483 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-25T09:25:46.484 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-25T09:25:46.485 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-25T09:25:46.486 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-25T09:25:46.487 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-25T09:25:46.488 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-25T09:25:46.489 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-25T09:25:46.490 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-25T09:25:46.491 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-25T09:25:46.492 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-25T09:25:46.493 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-25T09:25:46.494 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-25T09:25:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-25T09:25:46.496 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-25T09:25:46.497 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-25T09:25:46.498 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-25T09:25:46.499 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-25T09:25:46.500 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-25T09:25:46.501 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-25T09:25:46.502 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-25T09:25:46.503 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-dev.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband 2023-08-25T09:25:46.504 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-25T09:25:46.505 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca 2023-08-25T09:25:46.506 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-25T09:25:46.507 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-25T09:25:46.508 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse 2023-08-25T09:25:46.509 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-25T09:25:46.510 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-25T09:25:46.511 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-25T09:25:46.512 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-25T09:25:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-25T09:25:46.514 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-25T09:25:46.515 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-25T09:25:46.516 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion 2023-08-25T09:25:46.517 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd 2023-08-25T09:25:46.518 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mfd-core.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc 2023-08-25T09:25:46.519 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom 2023-08-25T09:25:46.520 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-25T09:25:46.521 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-25T09:25:46.522 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-25T09:25:46.523 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa 2023-08-25T09:25:46.524 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-25T09:25:46.525 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390 2023-08-25T09:25:46.526 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-25T09:25:46.527 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-25T09:25:46.528 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx 2023-08-25T09:25:46.529 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-25T09:25:46.530 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio 2023-08-25T09:25:46.531 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-25T09:25:46.532 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-25T09:25:46.533 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-25T09:25:46.534 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel 2023-08-25T09:25:46.535 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e 2023-08-25T09:25:46.536 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-25T09:25:46.537 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-25T09:25:46.538 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel 2023-08-25T09:25:46.539 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-25T09:25:46.540 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic 2023-08-25T09:25:46.541 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek 2023-08-25T09:25:46.542 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-25T09:25:46.543 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-25T09:25:46.544 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun 2023-08-25T09:25:46.545 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-25T09:25:46.546 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-25T09:25:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan 2023-08-25T09:25:46.548 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-25T09:25:46.549 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/net_failover.ko 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-25T09:25:46.550 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-25T09:25:46.551 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/dp83640.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-25T09:25:46.552 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-25T09:25:46.553 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-25T09:25:46.554 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slhc.ko 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-25T09:25:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tun.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/virtio_net.ko 2023-08-25T09:25:46.556 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netfront.ko 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb 2023-08-25T09:25:46.557 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-25T09:25:46.558 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-25T09:25:46.559 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-25T09:25:46.560 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-25T09:25:46.561 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-25T09:25:46.562 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-25T09:25:46.563 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients 2023-08-25T09:25:46.564 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc 2023-08-25T09:25:46.565 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-25T09:25:46.566 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-25T09:25:46.567 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-25T09:25:46.568 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-25T09:25:46.569 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-25T09:25:46.570 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-25T09:25:46.571 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i 2023-08-25T09:25:46.572 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-25T09:25:46.573 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-25T09:25:46.574 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic 2023-08-25T09:25:46.575 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci 2023-08-25T09:25:46.576 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas 2023-08-25T09:25:46.577 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-25T09:25:46.578 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-25T09:25:46.579 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-25T09:25:46.580 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-25T09:25:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target 2023-08-25T09:25:46.582 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-25T09:25:46.583 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-25T09:25:46.584 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-25T09:25:46.585 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless 2023-08-25T09:25:46.586 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-25T09:25:46.587 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-25T09:25:46.588 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class 2023-08-25T09:25:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-25T09:25:46.590 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-25T09:25:46.591 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-25T09:25:46.592 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial 2023-08-25T09:25:46.593 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-25T09:25:46.594 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-25T09:25:46.595 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-25T09:25:46.596 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-25T09:25:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-25T09:25:46.598 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-25T09:25:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-25T09:25:46.600 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-25T09:25:46.601 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost 2023-08-25T09:25:46.602 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-25T09:25:46.603 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_balloon.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_mmio.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-25T09:25:46.604 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_ring.ko 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-25T09:25:46.605 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-25T09:25:46.606 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-25T09:25:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-25T09:25:46.608 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-25T09:25:46.609 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-25T09:25:46.610 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-25T09:25:46.611 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-25T09:25:46.612 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-25T09:25:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-25T09:25:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/fat.ko 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/vfat.ko 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-25T09:25:46.615 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/fuse.ko 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-25T09:25:46.616 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-25T09:25:46.617 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout 2023-08-25T09:25:46.618 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd 2023-08-25T09:25:46.619 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-25T09:25:46.620 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-25T09:25:46.621 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-25T09:25:46.622 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-25T09:25:46.623 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-25T09:25:46.624 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-25T09:25:46.625 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-25T09:25:46.626 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-25T09:25:46.627 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-25T09:25:46.628 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-25T09:25:46.629 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-25T09:25:46.630 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu/rcutorture.ko 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib 2023-08-25T09:25:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/asn1_encoder.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-25T09:25:46.632 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon 2023-08-25T09:25:46.633 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd/zstd_compress.ko 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-25T09:25:46.634 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-25T09:25:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-25T09:25:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv 2023-08-25T09:25:46.637 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-25T09:25:46.638 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-25T09:25:46.639 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-25T09:25:46.640 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-25T09:25:46.641 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/failover.ko 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-25T09:25:46.642 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver/dns_resolver.ko 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-25T09:25:46.643 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-25T09:25:46.644 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-25T09:25:46.645 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-25T09:25:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-25T09:25:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-25T09:25:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-25T09:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-25T09:25:46.650 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-25T09:25:46.651 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-25T09:25:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-25T09:25:46.653 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-25T09:25:46.654 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp 2023-08-25T09:25:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc 2023-08-25T09:25:46.656 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-25T09:25:46.657 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-25T09:25:46.658 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs 2023-08-25T09:25:46.659 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-25T09:25:46.660 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-25T09:25:46.661 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-25T09:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-25T09:25:46.663 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-25T09:25:46.664 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-25T09:25:46.665 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-25T09:25:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_quota.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-25T09:25:46.667 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tunnel.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-25T09:25:46.668 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-25T09:25:46.669 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-25T09:25:46.670 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-25T09:25:46.671 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-25T09:25:46.672 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-25T09:25:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-25T09:25:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-25T09:25:46.675 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-25T09:25:46.676 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-25T09:25:46.677 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-25T09:25:46.678 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-25T09:25:46.679 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-25T09:25:46.680 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-25T09:25:46.681 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-25T09:25:46.682 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-25T09:25:46.683 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp 2023-08-25T09:25:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma 2023-08-25T09:25:46.685 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-25T09:25:46.686 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys 2023-08-25T09:25:46.687 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys/trusted.ko 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-25T09:25:46.688 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.alias.bin 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-25T09:25:46.689 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-25T09:25:46.690 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-25T09:25:46.690 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-25T09:25:46.690 INFO:teuthology.orchestra.run.smithi149.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-25T09:25:46.690 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.691 DEBUG:teuthology.orchestra.run.smithi149:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-25T09:25:46.715 INFO:teuthology.orchestra.run.smithi149.stdout:postinstall scriptlet (using /bin/sh): 2023-08-25T09:25:46.715 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-ga6a696707610 -a -r /boot/System.map-6.5.0-rc7-ga6a696707610 ]; then 2023-08-25T09:25:46.715 INFO:teuthology.orchestra.run.smithi149.stdout:cp /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T09:25:46.715 INFO:teuthology.orchestra.run.smithi149.stdout:cp /boot/System.map-6.5.0-rc7-ga6a696707610 /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T09:25:46.715 INFO:teuthology.orchestra.run.smithi149.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.715 INFO:teuthology.orchestra.run.smithi149.stdout:/sbin/installkernel 6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:new-kernel-pkg --remove 6.5.0-rc7-ga6a696707610 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-ga6a696707610.img 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-25T09:25:46.716 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-install remove 6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.717 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2023-08-25T09:25:46.717 INFO:teuthology.orchestra.run.smithi149.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-25T09:25:46.717 INFO:teuthology.orchestra.run.smithi149.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-25T09:25:46.717 INFO:teuthology.orchestra.run.smithi149.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.717 INFO:teuthology.orchestra.run.smithi149.stdout:fi 2023-08-25T09:25:46.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2023-08-25T09:25:46.806 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2023-08-25T09:25:46.806 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2023-08-25T09:25:46.806 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2023-08-25T09:25:46.806 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 53.el9 2023-08-25T09:25:46.807 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2023-08-25T09:25:46.807 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Mon 30 Jan 2023 10:38:40 AM UTC 2023-08-25T09:25:46.807 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2023-08-25T09:25:46.807 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8551923 2023-08-25T09:25:46.807 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2023-08-25T09:25:46.808 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Wed 18 Jan 2023 04:40:07 PM UTC, Key ID 05b555b38483c65d 2023-08-25T09:25:46.808 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-53.el9.src.rpm 2023-08-25T09:25:46.808 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 13 Jan 2023 09:07:28 PM UTC 2023-08-25T09:25:46.808 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-08-25T09:25:46.809 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2023-08-25T09:25:46.809 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2023-08-25T09:25:46.809 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-25T09:25:46.809 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2023-08-25T09:25:46.810 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2023-08-25T09:25:46.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:25:46.810 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-25T09:25:46.811 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-25T09:25:46.811 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-25T09:25:46.811 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2023-08-25T09:25:46.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:25:46.811 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2023-08-25T09:25:46.812 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-25T09:25:46.812 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 6.5.0-rc7-ga6a696707610 2023-08-25T09:25:46.812 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-25T09:25:47.418 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2023-08-25T09:25:48.844 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-08-25T09:25:48.878 INFO:teuthology.orchestra.run.smithi149.stderr:done 2023-08-25T09:25:48.887 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-08-25T09:25:48.942 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.8piiGU2Npf 2023-08-25T09:25:48.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8piiGU2Npf 2023-08-25T09:25:49.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.8piiGU2Npf 2023-08-25T09:25:49.171 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.8piiGU2Npf is 6KB 2023-08-25T09:25:49.218 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.8piiGU2Npf 2023-08-25T09:25:49.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2023-08-25T09:25:49.299 INFO:teuthology.orchestra.run.smithi149.stdout:e13cba1d25f14c51a1d04da8db823a4e-0-rescue.conf 2023-08-25T09:25:49.299 INFO:teuthology.orchestra.run.smithi149.stdout:e13cba1d25f14c51a1d04da8db823a4e-5.14.0-239.el9.x86_64.conf 2023-08-25T09:25:49.300 INFO:teuthology.orchestra.run.smithi149.stdout:e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc7-ga6a696707610.conf 2023-08-25T09:25:49.301 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default e13cba1d25f14c51a1d04da8db823a4e-6.5.0-rc7-ga6a696707610 2023-08-25T09:25:49.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2023-08-25T09:26:19.489 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-25T09:26:19.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:26:19.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:26:37.940 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-25T09:26:46.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:26:46.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:26:50.000 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-25T09:27:02.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:27:02.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:27:20.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-25T09:27:35.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:27:35.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:27:35.831 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-08-25T09:27:36.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:27:36.593 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-ga6a696707610"... 2023-08-25T09:27:36.593 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-08-25T09:27:36.637 INFO:teuthology.orchestra.run.smithi149.stdout:6.5.0-rc7-ga6a696707610 2023-08-25T09:27:36.637 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-25T09:27:36.637 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-25T09:27:36.637 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-25T09:27:37.638 DEBUG:teuthology.parallel:result is None 2023-08-25T09:27:37.639 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-25T09:27:37.646 INFO:teuthology.task.internal:Creating test directory... 2023-08-25T09:27:37.647 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T09:27:37.650 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T09:27:37.654 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T09:27:37.698 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-25T09:27:37.704 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-25T09:27:37.710 INFO:teuthology.task.internal:Creating archive directory... 2023-08-25T09:27:37.711 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T09:27:37.713 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T09:27:37.715 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T09:27:37.825 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-25T09:27:37.835 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-25T09:27:37.836 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T09:27:37.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:27:37.852 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T09:27:37.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:27:37.869 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T09:27:37.895 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T09:27:37.912 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T09:27:37.952 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T09:27:37.965 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T09:27:37.966 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T09:27:37.979 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T09:27:38.075 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T09:27:38.130 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T09:27:38.134 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-25T09:27:38.141 INFO:teuthology.task.internal:Configuring sudo... 2023-08-25T09:27:38.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T09:27:38.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T09:27:38.145 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T09:27:38.222 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-25T09:27:38.230 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-25T09:27:38.231 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T09:27:38.233 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T09:27:38.236 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T09:27:38.277 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T09:27:38.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T09:27:38.377 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T09:27:38.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T09:27:38.503 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:27:38.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T09:27:38.572 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T09:27:38.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T09:27:38.674 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T09:27:38.754 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T09:27:38.802 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:27:38.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T09:27:38.871 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T09:27:38.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T09:27:39.026 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T09:27:39.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T09:27:39.174 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:27:39.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T09:27:39.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-08-25T09:27:39.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2023-08-25T09:27:39.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-08-25T09:27:39.299 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T09:27:39.300 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T09:27:39.398 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T09:27:39.757 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-25T09:27:39.765 INFO:teuthology.task.internal:Starting timer... 2023-08-25T09:27:39.766 INFO:teuthology.run_tasks:Running task pcp... 2023-08-25T09:27:39.779 INFO:teuthology.run_tasks:Running task selinux... 2023-08-25T09:27:39.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-08-25T09:27:39.855 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-08-25T09:27:39.857 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2023-08-25T09:27:39.912 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2023-08-25T09:27:39.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2023-08-25T09:27:40.036 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2023-08-25T09:27:40.039 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-25T09:27:40.039 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-08-25T09:27:40.064 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-08-25T09:27:40.065 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2023-08-25T09:27:40.091 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2023-08-25T09:27:40.092 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2023-08-25T09:27:40.153 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2023-08-25T09:27:40.153 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2023-08-25T09:27:40.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T09:27:40.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:27:40.188 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T09:27:40.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:27:40.220 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T09:27:40.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:27:40.302 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-25T09:27:40.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-08-25T09:27:40.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2023-08-25T09:27:40.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2023-08-25T09:27:40.457 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-25T09:27:40.466 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-25T09:27:40.473 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-25T09:27:40.611 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-25T09:27:40.632 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-25T09:27:40.633 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi121.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-25T09:39:04.355 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2023-08-25T09:39:04.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-25T09:39:04.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:39:04.444 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-08-25T09:39:04.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-25T09:39:04.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-08-25T09:39:04.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:39:04.603 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-08-25T09:39:04.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-08-25T09:39:04.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:39:04.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T09:39:04.803 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-08-25T09:39:04.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-25T09:39:04.968 INFO:teuthology.run_tasks:Running task clock... 2023-08-25T09:39:04.982 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-25T09:39:04.982 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T09:39:04.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T09:39:04.986 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T09:39:04.987 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T09:39:04.989 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T09:39:04.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T09:39:05.019 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T09:39:05.021 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T09:39:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T09:39:05.039 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T09:39:05.069 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-08-25T09:39:05.070 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2023-08-25T09:39:05.083 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-08-25T09:39:05.084 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2023-08-25T09:39:05.093 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T09:39:05.100 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T09:39:05.101 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T09:39:05.118 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T09:39:05.118 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T09:39:05.149 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T09:39:05.160 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-08-25T09:39:05.161 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2023-08-25T09:39:05.163 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T09:39:05.163 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-08-25T09:39:05.163 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.163 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.164 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.164 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.165 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T09:39:05.165 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2023-08-25T09:39:05.166 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.166 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.166 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.166 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.247 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2023-08-25T09:39:05.289 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2023-08-25T09:39:05.341 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T09:39:05.394 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T09:39:05.522 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2023-08-25T09:39:05.532 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T09:39:05.532 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-08-25T09:39:05.533 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.533 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.533 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.533 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T09:39:05.534 INFO:teuthology.run_tasks:Running task install... 2023-08-25T09:39:05.543 DEBUG:teuthology.task.install:project ceph 2023-08-25T09:39:05.544 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}} 2023-08-25T09:39:05.544 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'} 2023-08-25T09:39:05.544 INFO:teuthology.task.install:Using flavor: default 2023-08-25T09:39:05.551 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-25T09:39:05.552 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-25T09:39:05.552 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T09:39:05.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:39:05.555 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T09:39:05.555 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:39:05.556 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T09:39:05.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:39:05.701 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/ 2023-08-25T09:39:05.701 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T09:39:05.724 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/ 2023-08-25T09:39:05.724 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T09:39:05.809 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/ 2023-08-25T09:39:05.810 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T09:39:05.836 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T09:39:05.837 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:39:05.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T09:39:05.936 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T09:39:05.937 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T09:39:06.019 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T09:39:06.019 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:39:06.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T09:39:06.050 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T09:39:06.051 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T09:39:06.064 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T09:39:06.064 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:39:06.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T09:39:06.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T09:39:06.096 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T09:39:06.096 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T09:39:06.122 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T09:39:06.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T09:39:06.206 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T09:39:06.220 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T09:39:06.249 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T09:39:06.274 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2023-08-25T09:39:06.275 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2023-08-25T09:39:06.317 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-08-25T09:39:06.317 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2023-08-25T09:39:06.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-08-25T09:39:06.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2023-08-25T09:39:06.508 INFO:teuthology.orchestra.run.smithi121.stdout:72 files removed 2023-08-25T09:39:06.534 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T09:39:06.550 INFO:teuthology.orchestra.run.smithi089.stdout:72 files removed 2023-08-25T09:39:06.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T09:39:06.684 INFO:teuthology.orchestra.run.smithi149.stdout:72 files removed 2023-08-25T09:39:06.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T09:39:07.216 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 184 kB/s | 78 kB 00:00 2023-08-25T09:39:07.320 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 162 kB/s | 78 kB 00:00 2023-08-25T09:39:07.551 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-08-25T09:39:07.612 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 167 kB/s | 78 kB 00:00 2023-08-25T09:39:07.721 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-08-25T09:39:07.968 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2023-08-25T09:39:08.130 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-08-25T09:39:08.154 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-08-25T09:39:08.588 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-08-25T09:39:08.715 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - AppStream 11 MB/s | 6.2 MB 00:00 2023-08-25T09:39:08.745 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS-9 - AppStream 8.2 MB/s | 6.2 MB 00:00 2023-08-25T09:39:09.174 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 12 MB/s | 6.2 MB 00:00 2023-08-25T09:39:10.124 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-08-25T09:39:10.171 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-08-25T09:39:10.691 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2023-08-25T09:39:10.999 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.8 MB 00:00 2023-08-25T09:39:11.028 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.8 MB 00:00 2023-08-25T09:39:12.742 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 23 MB/s | 18 MB 00:00 2023-08-25T09:39:12.838 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 7.8 MB 00:01 2023-08-25T09:39:15.073 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-08-25T09:39:16.087 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 18 MB 00:04 2023-08-25T09:39:16.568 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 5.7 MB 00:00 2023-08-25T09:39:17.885 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 14 kB 00:00 2023-08-25T09:39:18.862 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 21 MB/s | 18 MB 00:00 2023-08-25T09:39:19.240 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 5.7 MB 00:00 2023-08-25T09:39:20.750 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 14 kB 00:00 2023-08-25T09:39:20.897 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.7 MB 00:01 2023-08-25T09:39:22.198 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 14 kB 00:00 2023-08-25T09:39:23.691 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 13 MB/s | 18 MB 00:01 2023-08-25T09:39:25.018 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 18 MB 00:04 2023-08-25T09:39:25.039 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-25T09:39:25.040 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-25T09:39:25.051 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-25T09:39:25.052 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-25T09:39:25.053 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-25T09:39:25.054 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-25T09:39:25.055 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-25T09:39:25.058 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-25T09:39:25.059 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-25T09:39:25.131 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-08-25T09:39:25.176 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-08-25T09:39:25.176 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-08-25T09:39:25.176 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-08-25T09:39:25.177 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-08-25T09:39:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-25T09:39:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 6.5 k 2023-08-25T09:39:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 5.2 M 2023-08-25T09:39:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 850 k 2023-08-25T09:39:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 141 k 2023-08-25T09:39:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 1.5 M 2023-08-25T09:39:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 132 k 2023-08-25T09:39:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 1.7 M 2023-08-25T09:39:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 7.4 M 2023-08-25T09:39:25.178 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 47 k 2023-08-25T09:39:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 8.2 M 2023-08-25T09:39:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 40 M 2023-08-25T09:39:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 261 k 2023-08-25T09:39:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 225 k 2023-08-25T09:39:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 218 k 2023-08-25T09:39:25.179 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 18 k 2023-08-25T09:39:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-25T09:39:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-25T09:39:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-25T09:39:25.180 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 31 k 2023-08-25T09:39:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 667 k 2023-08-25T09:39:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 126 k 2023-08-25T09:39:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-25T09:39:25.181 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-14.el9 CentOS-AppStream 24 k 2023-08-25T09:39:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-25T09:39:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-25T09:39:25.182 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-25T09:39:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-25T09:39:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 161 k 2023-08-25T09:39:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 320 k 2023-08-25T09:39:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 297 k 2023-08-25T09:39:25.183 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 99 k 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 85 k 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.0 M 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 169 k 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager x86_64 1:1.44.0-2.el9 CentOS-BaseOS 2.2 M 2023-08-25T09:39:25.184 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm x86_64 1:1.44.0-2.el9 CentOS-BaseOS 1.8 M 2023-08-25T09:39:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team x86_64 1:1.44.0-2.el9 CentOS-BaseOS 41 k 2023-08-25T09:39:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui x86_64 1:1.44.0-2.el9 CentOS-BaseOS 245 k 2023-08-25T09:39:25.185 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-25T09:39:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-25T09:39:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-25T09:39:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-25T09:39:25.186 INFO:teuthology.orchestra.run.smithi089.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-25T09:39:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: libblkid x86_64 2.37.4-14.el9 CentOS-BaseOS 107 k 2023-08-25T09:39:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: libfdisk x86_64 2.37.4-14.el9 CentOS-BaseOS 154 k 2023-08-25T09:39:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: libmount x86_64 2.37.4-14.el9 CentOS-BaseOS 133 k 2023-08-25T09:39:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.3 M 2023-08-25T09:39:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.0 M 2023-08-25T09:39:25.187 INFO:teuthology.orchestra.run.smithi089.stdout: libsmartcols x86_64 2.37.4-14.el9 CentOS-BaseOS 63 k 2023-08-25T09:39:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid x86_64 2.37.4-14.el9 CentOS-BaseOS 28 k 2023-08-25T09:39:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-25T09:39:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-25T09:39:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux x86_64 2.37.4-14.el9 CentOS-BaseOS 2.2 M 2023-08-25T09:39:25.188 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-core x86_64 2.37.4-14.el9 CentOS-BaseOS 433 k 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-user x86_64 2.37.4-14.el9 CentOS-BaseOS 30 k 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs x86_64 5.19.0-4.el9 CentOS-BaseOS 1.0 M 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-25T09:39:25.189 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 19 M 2023-08-25T09:39:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 23 k 2023-08-25T09:39:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 2.1 M 2023-08-25T09:39:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 242 k 2023-08-25T09:39:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 4.4 M 2023-08-25T09:39:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 18 M 2023-08-25T09:39:25.190 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 15 k 2023-08-25T09:39:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 24 k 2023-08-25T09:39:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-25T09:39:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-25T09:39:25.191 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-25T09:39:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-25T09:39:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-25T09:39:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-25T09:39:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-25T09:39:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-25T09:39:25.192 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-25T09:39:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 164 k 2023-08-25T09:39:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-25T09:39:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-25T09:39:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-25T09:39:25.193 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 473 k 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 4.7 M 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-25T09:39:25.194 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-25T09:39:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-25T09:39:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-25T09:39:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-25T09:39:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-25T09:39:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-25T09:39:25.195 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-25T09:39:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-25T09:39:25.196 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-25T09:39:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-25T09:39:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 45 k 2023-08-25T09:39:25.197 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 127 k 2023-08-25T09:39:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-25T09:39:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-25T09:39:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-25T09:39:25.198 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-25T09:39:25.199 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-25T09:39:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-25T09:39:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-25T09:39:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-25T09:39:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-25T09:39:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-25T09:39:25.200 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-25T09:39:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-25T09:39:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-25T09:39:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-25T09:39:25.201 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-25T09:39:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-25T09:39:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-25T09:39:25.202 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-25T09:39:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-25T09:39:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-25T09:39:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-25T09:39:25.203 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-25T09:39:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-25T09:39:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-25T09:39:25.204 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-25T09:39:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-25T09:39:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-25T09:39:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-25T09:39:25.205 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-25T09:39:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-25T09:39:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-25T09:39:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-25T09:39:25.206 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-25T09:39:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-25T09:39:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-25T09:39:25.207 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-25T09:39:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-25T09:39:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-25T09:39:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-25T09:39:25.208 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-25T09:39:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-25T09:39:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-25T09:39:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-25T09:39:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-25T09:39:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-25T09:39:25.209 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-25T09:39:25.210 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2023-08-25T09:39:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-25T09:39:25.210 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:39:25.210 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-08-25T09:39:25.210 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-08-25T09:39:25.210 INFO:teuthology.orchestra.run.smithi089.stdout:Install 131 Packages 2023-08-25T09:39:25.211 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 23 Packages 2023-08-25T09:39:25.211 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:39:25.211 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 206 M 2023-08-25T09:39:25.212 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-08-25T09:39:25.580 INFO:teuthology.orchestra.run.smithi089.stdout:(1/154): ceph-18.0.0-5703.gba6b39e4.el9.x86_64. 39 kB/s | 6.5 kB 00:00 2023-08-25T09:39:25.797 INFO:teuthology.orchestra.run.smithi089.stdout:(2/154): ceph-fuse-18.0.0-5703.gba6b39e4.el9.x8 3.8 MB/s | 850 kB 00:00 2023-08-25T09:39:25.865 INFO:teuthology.orchestra.run.smithi089.stdout:(3/154): ceph-immutable-object-cache-18.0.0-570 2.1 MB/s | 141 kB 00:00 2023-08-25T09:39:25.981 INFO:teuthology.orchestra.run.smithi089.stdout:(4/154): ceph-base-18.0.0-5703.gba6b39e4.el9.x8 9.1 MB/s | 5.2 MB 00:00 2023-08-25T09:39:26.073 INFO:teuthology.orchestra.run.smithi089.stdout:(5/154): ceph-mds-18.0.0-5703.gba6b39e4.el9.x86 10 MB/s | 2.1 MB 00:00 2023-08-25T09:39:26.129 INFO:teuthology.orchestra.run.smithi089.stdout:(6/154): ceph-mgr-18.0.0-5703.gba6b39e4.el9.x86 9.9 MB/s | 1.5 MB 00:00 2023-08-25T09:39:26.523 INFO:teuthology.orchestra.run.smithi089.stdout:(7/154): ceph-mon-18.0.0-5703.gba6b39e4.el9.x86 9.7 MB/s | 4.4 MB 00:00 2023-08-25T09:39:27.282 INFO:teuthology.orchestra.run.smithi089.stdout:(8/154): ceph-osd-18.0.0-5703.gba6b39e4.el9.x86 15 MB/s | 18 MB 00:01 2023-08-25T09:39:27.324 INFO:teuthology.orchestra.run.smithi089.stdout:(9/154): ceph-selinux-18.0.0-5703.gba6b39e4.el9 584 kB/s | 24 kB 00:00 2023-08-25T09:39:27.566 INFO:teuthology.orchestra.run.smithi089.stdout:(10/154): ceph-radosgw-18.0.0-5703.gba6b39e4.el 7.8 MB/s | 8.2 MB 00:01 2023-08-25T09:39:27.633 INFO:teuthology.orchestra.run.smithi089.stdout:(11/154): cephfs-mirror-18.0.0-5703.gba6b39e4.e 3.2 MB/s | 218 kB 00:00 2023-08-25T09:39:27.700 INFO:teuthology.orchestra.run.smithi089.stdout:(12/154): libcephfs-devel-18.0.0-5703.gba6b39e4 470 kB/s | 31 kB 00:00 2023-08-25T09:39:27.842 INFO:teuthology.orchestra.run.smithi089.stdout:(13/154): libcephfs2-18.0.0-5703.gba6b39e4.el9. 4.6 MB/s | 667 kB 00:00 2023-08-25T09:39:27.926 INFO:teuthology.orchestra.run.smithi089.stdout:(14/154): libcephsqlite-18.0.0-5703.gba6b39e4.e 1.9 MB/s | 164 kB 00:00 2023-08-25T09:39:28.009 INFO:teuthology.orchestra.run.smithi089.stdout:(15/154): librados-devel-18.0.0-5703.gba6b39e4. 1.5 MB/s | 126 kB 00:00 2023-08-25T09:39:28.110 INFO:teuthology.orchestra.run.smithi089.stdout:(16/154): libradosstriper1-18.0.0-5703.gba6b39e 4.6 MB/s | 473 kB 00:00 2023-08-25T09:39:28.819 INFO:teuthology.orchestra.run.smithi089.stdout:(17/154): librgw2-18.0.0-5703.gba6b39e4.el9.x86 6.6 MB/s | 4.7 MB 00:00 2023-08-25T09:39:28.919 INFO:teuthology.orchestra.run.smithi089.stdout:(18/154): python3-ceph-argparse-18.0.0-5703.gba 452 kB/s | 45 kB 00:00 2023-08-25T09:39:29.011 INFO:teuthology.orchestra.run.smithi089.stdout:(19/154): python3-ceph-common-18.0.0-5703.gba6b 1.4 MB/s | 127 kB 00:00 2023-08-25T09:39:29.102 INFO:teuthology.orchestra.run.smithi089.stdout:(20/154): python3-cephfs-18.0.0-5703.gba6b39e4. 1.7 MB/s | 161 kB 00:00 2023-08-25T09:39:29.662 INFO:teuthology.orchestra.run.smithi089.stdout:(21/154): ceph-test-18.0.0-5703.gba6b39e4.el9.x 17 MB/s | 40 MB 00:02 2023-08-25T09:39:29.695 INFO:teuthology.orchestra.run.smithi089.stdout:(22/154): python3-rados-18.0.0-5703.gba6b39e4.e 541 kB/s | 320 kB 00:00 2023-08-25T09:39:29.737 INFO:teuthology.orchestra.run.smithi089.stdout:(23/154): python3-rbd-18.0.0-5703.gba6b39e4.el9 3.9 MB/s | 297 kB 00:00 2023-08-25T09:39:29.771 INFO:teuthology.orchestra.run.smithi089.stdout:(24/154): python3-rgw-18.0.0-5703.gba6b39e4.el9 1.3 MB/s | 99 kB 00:00 2023-08-25T09:39:29.791 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-25T09:39:29.792 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-25T09:39:29.803 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-25T09:39:29.803 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-25T09:39:29.804 INFO:teuthology.orchestra.run.smithi089.stdout:(25/154): rbd-fuse-18.0.0-5703.gba6b39e4.el9.x8 1.2 MB/s | 85 kB 00:00 2023-08-25T09:39:29.804 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-25T09:39:29.805 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-25T09:39:29.806 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-25T09:39:29.810 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-25T09:39:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:(26/154): rbd-nbd-18.0.0-5703.gba6b39e4.el9.x86 2.2 MB/s | 169 kB 00:00 2023-08-25T09:39:29.882 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-08-25T09:39:29.915 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================================ 2023-08-25T09:39:29.915 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-08-25T09:39:29.915 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================================ 2023-08-25T09:39:29.916 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-08-25T09:39:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-25T09:39:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 6.5 k 2023-08-25T09:39:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 5.2 M 2023-08-25T09:39:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 850 k 2023-08-25T09:39:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 141 k 2023-08-25T09:39:29.917 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 1.5 M 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 132 k 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 1.7 M 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 7.4 M 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 47 k 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 8.2 M 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 40 M 2023-08-25T09:39:29.918 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 261 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 225 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 218 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 18 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 31 k 2023-08-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 667 k 2023-08-25T09:39:29.920 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 126 k 2023-08-25T09:39:29.920 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-25T09:39:29.920 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-14.el9 CentOS-AppStream 24 k 2023-08-25T09:39:29.921 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-25T09:39:29.921 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-25T09:39:29.921 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-25T09:39:29.921 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-25T09:39:29.921 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 161 k 2023-08-25T09:39:29.921 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 320 k 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 297 k 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 99 k 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 85 k 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.0 M 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 169 k 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2023-08-25T09:39:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.44.0-2.el9 CentOS-BaseOS 2.2 M 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.44.0-2.el9 CentOS-BaseOS 1.8 M 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.44.0-2.el9 CentOS-BaseOS 41 k 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.44.0-2.el9 CentOS-BaseOS 245 k 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-25T09:39:29.923 INFO:teuthology.orchestra.run.smithi121.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: libblkid x86_64 2.37.4-14.el9 CentOS-BaseOS 107 k 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: libfdisk x86_64 2.37.4-14.el9 CentOS-BaseOS 154 k 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: libmount x86_64 2.37.4-14.el9 CentOS-BaseOS 133 k 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.3 M 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.0 M 2023-08-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi121.stdout: libsmartcols x86_64 2.37.4-14.el9 CentOS-BaseOS 63 k 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid x86_64 2.37.4-14.el9 CentOS-BaseOS 28 k 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux x86_64 2.37.4-14.el9 CentOS-BaseOS 2.2 M 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-core x86_64 2.37.4-14.el9 CentOS-BaseOS 433 k 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-user x86_64 2.37.4-14.el9 CentOS-BaseOS 30 k 2023-08-25T09:39:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs x86_64 5.19.0-4.el9 CentOS-BaseOS 1.0 M 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 19 M 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 23 k 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 2.1 M 2023-08-25T09:39:29.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 242 k 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 4.4 M 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 18 M 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 15 k 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 24 k 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-25T09:39:29.927 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-25T09:39:29.928 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 164 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 473 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-25T09:39:29.929 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 4.7 M 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-25T09:39:29.930 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 45 k 2023-08-25T09:39:29.931 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 127 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-25T09:39:29.932 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-25T09:39:29.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-25T09:39:29.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-25T09:39:29.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-25T09:39:29.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-25T09:39:29.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-25T09:39:29.938 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-25T09:39:29.938 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-25T09:39:29.938 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-25T09:39:29.938 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-25T09:39:29.938 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-25T09:39:29.938 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================================ 2023-08-25T09:39:29.939 INFO:teuthology.orchestra.run.smithi121.stdout:Install 131 Packages 2023-08-25T09:39:29.940 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 23 Packages 2023-08-25T09:39:29.940 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:39:29.940 INFO:teuthology.orchestra.run.smithi089.stdout:(27/154): ceph-grafana-dashboards-18.0.0-5703.g 398 kB/s | 23 kB 00:00 2023-08-25T09:39:29.941 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 206 M 2023-08-25T09:39:29.941 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-08-25T09:39:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:(28/154): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 1.7 MB/s | 132 kB 00:00 2023-08-25T09:39:30.072 INFO:teuthology.orchestra.run.smithi089.stdout:(29/154): rbd-mirror-18.0.0-5703.gba6b39e4.el9. 10 MB/s | 3.0 MB 00:00 2023-08-25T09:39:30.197 INFO:teuthology.orchestra.run.smithi089.stdout:(30/154): ceph-mgr-dashboard-18.0.0-5703.gba6b3 9.5 MB/s | 1.7 MB 00:00 2023-08-25T09:39:30.273 INFO:teuthology.orchestra.run.smithi089.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5703.gba 3.2 MB/s | 242 kB 00:00 2023-08-25T09:39:30.339 INFO:teuthology.orchestra.run.smithi089.stdout:(32/154): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 716 kB/s | 47 kB 00:00 2023-08-25T09:39:30.398 INFO:teuthology.orchestra.run.smithi089.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5703.gb 252 kB/s | 15 kB 00:00 2023-08-25T09:39:30.482 INFO:teuthology.orchestra.run.smithi089.stdout:(34/154): ceph-volume-18.0.0-5703.gba6b39e4.el9 3.1 MB/s | 261 kB 00:00 2023-08-25T09:39:30.557 INFO:teuthology.orchestra.run.smithi089.stdout:(35/154): cephadm-18.0.0-5703.gba6b39e4.el9.noa 2.9 MB/s | 225 kB 00:00 2023-08-25T09:39:30.615 INFO:teuthology.orchestra.run.smithi089.stdout:(36/154): cephfs-top-18.0.0-5703.gba6b39e4.el9. 311 kB/s | 18 kB 00:00 2023-08-25T09:39:30.616 INFO:teuthology.orchestra.run.smithi121.stdout:(1/154): ceph-18.0.0-5703.gba6b39e4.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2023-08-25T09:39:30.716 INFO:teuthology.orchestra.run.smithi089.stdout:(37/154): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-08-25T09:39:31.100 INFO:teuthology.orchestra.run.smithi089.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 662 kB 00:00 2023-08-25T09:39:31.193 INFO:teuthology.orchestra.run.smithi089.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 920 kB 00:00 2023-08-25T09:39:31.226 INFO:teuthology.orchestra.run.smithi089.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 849 kB/s | 106 kB 00:00 2023-08-25T09:39:31.267 INFO:teuthology.orchestra.run.smithi089.stdout:(41/154): elfutils-libelf-devel-0.189-3.el9.x86 284 kB/s | 21 kB 00:00 2023-08-25T09:39:31.359 INFO:teuthology.orchestra.run.smithi121.stdout:(2/154): ceph-base-18.0.0-5703.gba6b39e4.el9.x8 4.8 MB/s | 5.2 MB 00:01 2023-08-25T09:39:31.359 INFO:teuthology.orchestra.run.smithi089.stdout:(42/154): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 307 kB 00:00 2023-08-25T09:39:31.385 INFO:teuthology.orchestra.run.smithi089.stdout:(43/154): flexiblas-3.0.4-8.el9.x86_64.rpm 270 kB/s | 32 kB 00:00 2023-08-25T09:39:31.401 INFO:teuthology.orchestra.run.smithi121.stdout:(3/154): ceph-fuse-18.0.0-5703.gba6b39e4.el9.x8 1.1 MB/s | 850 kB 00:00 2023-08-25T09:39:31.434 INFO:teuthology.orchestra.run.smithi121.stdout:(4/154): ceph-immutable-object-cache-18.0.0-570 1.8 MB/s | 141 kB 00:00 2023-08-25T09:39:31.585 INFO:teuthology.orchestra.run.smithi121.stdout:(5/154): ceph-mgr-18.0.0-5703.gba6b39e4.el9.x86 9.7 MB/s | 1.5 MB 00:00 2023-08-25T09:39:31.602 INFO:teuthology.orchestra.run.smithi089.stdout:(44/154): flexiblas-openblas-openmp-3.0.4-8.el9 79 kB/s | 17 kB 00:00 2023-08-25T09:39:31.710 INFO:teuthology.orchestra.run.smithi089.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2023-08-25T09:39:31.744 INFO:teuthology.orchestra.run.smithi089.stdout:(46/154): jq-1.6-15.el9.x86_64.rpm 1.3 MB/s | 186 kB 00:00 2023-08-25T09:39:31.769 INFO:teuthology.orchestra.run.smithi089.stdout:(47/154): libaio-devel-0.3.111-13.el9.x86_64.rp 172 kB/s | 10 kB 00:00 2023-08-25T09:39:31.819 INFO:teuthology.orchestra.run.smithi089.stdout:(48/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-08-25T09:39:31.845 INFO:teuthology.orchestra.run.smithi089.stdout:(49/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 586 kB/s | 44 kB 00:00 2023-08-25T09:39:31.903 INFO:teuthology.orchestra.run.smithi089.stdout:(50/154): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2023-08-25T09:39:31.910 INFO:teuthology.orchestra.run.smithi121.stdout:(6/154): ceph-mon-18.0.0-5703.gba6b39e4.el9.x86 13 MB/s | 4.4 MB 00:00 2023-08-25T09:39:31.936 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-25T09:39:31.937 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-08-25T09:39:31.945 INFO:teuthology.orchestra.run.smithi089.stdout:(51/154): libtool-2.4.6-45.el9.x86_64.rpm 5.6 MB/s | 578 kB 00:00 2023-08-25T09:39:31.957 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.41.8-1.el9.x86_64 is already installed. 2023-08-25T09:39:31.958 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.0.0-2.el9.x86_64 is already installed. 2023-08-25T09:39:31.959 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-9.el9.x86_64 is already installed. 2023-08-25T09:39:31.961 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-25T09:39:31.963 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-25T09:39:31.967 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.10-1.el9.x86_64 is already installed. 2023-08-25T09:39:31.968 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.14.2-1.el9.x86_64 is already installed. 2023-08-25T09:39:31.970 INFO:teuthology.orchestra.run.smithi089.stdout:(52/154): libuuid-devel-2.37.4-14.el9.x86_64.rp 371 kB/s | 24 kB 00:00 2023-08-25T09:39:31.996 INFO:teuthology.orchestra.run.smithi089.stdout:(53/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 926 kB/s | 46 kB 00:00 2023-08-25T09:39:32.038 INFO:teuthology.orchestra.run.smithi089.stdout:(54/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2023-08-25T09:39:32.051 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-08-25T09:39:32.078 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2023-08-25T09:39:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-08-25T09:39:32.078 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2023-08-25T09:39:32.078 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-08-25T09:39:32.078 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 6.5 k 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 5.2 M 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 850 k 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 141 k 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 1.5 M 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 132 k 2023-08-25T09:39:32.079 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 1.7 M 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 7.4 M 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 47 k 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 8.2 M 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 40 M 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 261 k 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 225 k 2023-08-25T09:39:32.080 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 218 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 18 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 CentOS-AppStream 21 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 31 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 667 k 2023-08-25T09:39:32.081 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 126 k 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-14.el9 CentOS-AppStream 24 k 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.0.7-24.el9 CentOS-AppStream 3.0 M 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-08-25T09:39:32.082 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 161 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 320 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 297 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 99 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 85 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.0 M 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 169 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-08-25T09:39:32.083 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.44.0-2.el9 CentOS-BaseOS 2.2 M 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.44.0-2.el9 CentOS-BaseOS 1.8 M 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.44.0-2.el9 CentOS-BaseOS 41 k 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.44.0-2.el9 CentOS-BaseOS 245 k 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client x86_64 0.189-3.el9 CentOS-BaseOS 36 k 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf x86_64 0.189-3.el9 CentOS-BaseOS 192 k 2023-08-25T09:39:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs x86_64 0.189-3.el9 CentOS-BaseOS 254 k 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: iproute x86_64 6.2.0-5.el9 CentOS-BaseOS 785 k 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: iproute-tc x86_64 6.2.0-5.el9 CentOS-BaseOS 448 k 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: libblkid x86_64 2.37.4-14.el9 CentOS-BaseOS 107 k 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: libfdisk x86_64 2.37.4-14.el9 CentOS-BaseOS 154 k 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: libmount x86_64 2.37.4-14.el9 CentOS-BaseOS 133 k 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.3 M 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 3.0 M 2023-08-25T09:39:32.085 INFO:teuthology.orchestra.run.smithi149.stdout: libsmartcols x86_64 2.37.4-14.el9 CentOS-BaseOS 63 k 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid x86_64 2.37.4-14.el9 CentOS-BaseOS 28 k 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.0.7-24.el9 CentOS-BaseOS 1.2 M 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.0.7-24.el9 CentOS-BaseOS 2.1 M 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux x86_64 2.37.4-14.el9 CentOS-BaseOS 2.2 M 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-core x86_64 2.37.4-14.el9 CentOS-BaseOS 433 k 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-user x86_64 2.37.4-14.el9 CentOS-BaseOS 30 k 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: xfsdump x86_64 3.1.12-3.el9 CentOS-BaseOS 321 k 2023-08-25T09:39:32.086 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs x86_64 5.19.0-4.el9 CentOS-BaseOS 1.0 M 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 19 M 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 23 k 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 2.1 M 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 242 k 2023-08-25T09:39:32.087 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 4.4 M 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 18 M 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el9 ceph-noarch 15 k 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 24 k 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-08-25T09:39:32.088 INFO:teuthology.orchestra.run.smithi149.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-15.el9 CentOS-AppStream 186 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 164 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-2.1.el9 CentOS-BaseOS 807 k 2023-08-25T09:39:32.089 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-2.1.el9 CentOS-BaseOS 197 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 473 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 4.7 M 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-08-25T09:39:32.090 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-08-25T09:39:32.091 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 45 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el9 ceph 127 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-08-25T09:39:32.092 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.16-1.el9 appstream 247 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.22.0-1.el9 epel 197 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-08-25T09:39:32.093 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-08-25T09:39:32.094 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-08-25T09:39:32.095 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-08-25T09:39:32.096 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-08-25T09:39:32.097 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-2.el9 epel 192 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-08-25T09:39:32.098 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-36.el9 appstream 45 k 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-08-25T09:39:32.099 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2023-08-25T09:39:32.100 INFO:teuthology.orchestra.run.smithi149.stdout:Install 131 Packages 2023-08-25T09:39:32.100 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 23 Packages 2023-08-25T09:39:32.100 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:39:32.100 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 206 M 2023-08-25T09:39:32.101 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-08-25T09:39:32.105 INFO:teuthology.orchestra.run.smithi089.stdout:(55/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.9 MB/s | 217 kB 00:00 2023-08-25T09:39:32.130 INFO:teuthology.orchestra.run.smithi089.stdout:(56/154): openblas-0.3.21-2.el9.x86_64.rpm 371 kB/s | 34 kB 00:00 2023-08-25T09:39:32.364 INFO:teuthology.orchestra.run.smithi089.stdout:(57/154): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2023-08-25T09:39:32.431 INFO:teuthology.orchestra.run.smithi089.stdout:(58/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 9.9 MB/s | 3.0 MB 00:00 2023-08-25T09:39:32.481 INFO:teuthology.orchestra.run.smithi089.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2023-08-25T09:39:32.523 INFO:teuthology.orchestra.run.smithi089.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 8.9 MB/s | 811 kB 00:00 2023-08-25T09:39:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 134 kB 00:00 2023-08-25T09:39:32.724 INFO:teuthology.orchestra.run.smithi089.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 28 MB/s | 5.7 MB 00:00 2023-08-25T09:39:32.786 INFO:teuthology.orchestra.run.smithi149.stdout:(1/154): ceph-18.0.0-5703.gba6b39e4.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2023-08-25T09:39:32.866 INFO:teuthology.orchestra.run.smithi089.stdout:(63/154): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-08-25T09:39:32.899 INFO:teuthology.orchestra.run.smithi089.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-08-25T09:39:32.916 INFO:teuthology.orchestra.run.smithi089.stdout:(65/154): python3-jsonpatch-1.21-16.el9.noarch. 492 kB/s | 24 kB 00:00 2023-08-25T09:39:32.942 INFO:teuthology.orchestra.run.smithi089.stdout:(66/154): python3-jsonpointer-2.0-4.el9.noarch. 433 kB/s | 18 kB 00:00 2023-08-25T09:39:32.952 INFO:teuthology.orchestra.run.smithi121.stdout:(7/154): ceph-osd-18.0.0-5703.gba6b39e4.el9.x86 17 MB/s | 18 MB 00:01 2023-08-25T09:39:32.976 INFO:teuthology.orchestra.run.smithi089.stdout:(67/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-08-25T09:39:33.010 INFO:teuthology.orchestra.run.smithi121.stdout:(8/154): ceph-mds-18.0.0-5703.gba6b39e4.el9.x86 1.3 MB/s | 2.1 MB 00:01 2023-08-25T09:39:33.011 INFO:teuthology.orchestra.run.smithi149.stdout:(2/154): ceph-fuse-18.0.0-5703.gba6b39e4.el9.x8 3.7 MB/s | 850 kB 00:00 2023-08-25T09:39:33.026 INFO:teuthology.orchestra.run.smithi089.stdout:(68/154): python3-markupsafe-1.1.1-12.el9.x86_6 379 kB/s | 32 kB 00:00 2023-08-25T09:39:33.184 INFO:teuthology.orchestra.run.smithi089.stdout:(69/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-08-25T09:39:33.218 INFO:teuthology.orchestra.run.smithi089.stdout:(70/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-08-25T09:39:33.252 INFO:teuthology.orchestra.run.smithi089.stdout:(71/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-08-25T09:39:33.277 INFO:teuthology.orchestra.run.smithi089.stdout:(72/154): python3-prettytable-0.7.2-27.el9.noar 705 kB/s | 41 kB 00:00 2023-08-25T09:39:33.310 INFO:teuthology.orchestra.run.smithi089.stdout:(73/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-08-25T09:39:33.344 INFO:teuthology.orchestra.run.smithi089.stdout:(74/154): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-08-25T09:39:33.369 INFO:teuthology.orchestra.run.smithi089.stdout:(75/154): python3-pytz-2021.1-5.el9.noarch.rpm 813 kB/s | 47 kB 00:00 2023-08-25T09:39:33.395 INFO:teuthology.orchestra.run.smithi089.stdout:(76/154): python3-requests-oauthlib-1.3.0-12.el 852 kB/s | 43 kB 00:00 2023-08-25T09:39:33.469 INFO:teuthology.orchestra.run.smithi121.stdout:(9/154): ceph-selinux-18.0.0-5703.gba6b39e4.el9 52 kB/s | 24 kB 00:00 2023-08-25T09:39:33.503 INFO:teuthology.orchestra.run.smithi149.stdout:(3/154): ceph-base-18.0.0-5703.gba6b39e4.el9.x8 4.9 MB/s | 5.2 MB 00:01 2023-08-25T09:39:33.628 INFO:teuthology.orchestra.run.smithi149.stdout:(4/154): ceph-immutable-object-cache-18.0.0-570 229 kB/s | 141 kB 00:00 2023-08-25T09:39:33.631 INFO:teuthology.orchestra.run.smithi121.stdout:(10/154): ceph-radosgw-18.0.0-5703.gba6b39e4.el 12 MB/s | 8.2 MB 00:00 2023-08-25T09:39:33.704 INFO:teuthology.orchestra.run.smithi149.stdout:(5/154): ceph-mds-18.0.0-5703.gba6b39e4.el9.x86 11 MB/s | 2.1 MB 00:00 2023-08-25T09:39:33.711 INFO:teuthology.orchestra.run.smithi121.stdout:(11/154): cephfs-mirror-18.0.0-5703.gba6b39e4.e 2.7 MB/s | 218 kB 00:00 2023-08-25T09:39:33.737 INFO:teuthology.orchestra.run.smithi089.stdout:(77/154): ceph-common-18.0.0-5703.gba6b39e4.el9 2.3 MB/s | 19 MB 00:08 2023-08-25T09:39:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:(12/154): libcephfs-devel-18.0.0-5703.gba6b39e4 416 kB/s | 31 kB 00:00 2023-08-25T09:39:33.846 INFO:teuthology.orchestra.run.smithi149.stdout:(6/154): ceph-mgr-18.0.0-5703.gba6b39e4.el9.x86 6.7 MB/s | 1.5 MB 00:00 2023-08-25T09:39:33.854 INFO:teuthology.orchestra.run.smithi089.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 84 kB/s | 39 kB 00:00 2023-08-25T09:39:33.895 INFO:teuthology.orchestra.run.smithi121.stdout:(13/154): libcephfs2-18.0.0-5703.gba6b39e4.el9. 6.0 MB/s | 667 kB 00:00 2023-08-25T09:39:33.987 INFO:teuthology.orchestra.run.smithi121.stdout:(14/154): libcephsqlite-18.0.0-5703.gba6b39e4.e 1.7 MB/s | 164 kB 00:00 2023-08-25T09:39:34.038 INFO:teuthology.orchestra.run.smithi089.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2023-08-25T09:39:34.071 INFO:teuthology.orchestra.run.smithi089.stdout:(80/154): socat-1.7.4.1-5.el9.x86_64.rpm 907 kB/s | 300 kB 00:00 2023-08-25T09:39:34.079 INFO:teuthology.orchestra.run.smithi121.stdout:(15/154): librados-devel-18.0.0-5703.gba6b39e4. 1.3 MB/s | 126 kB 00:00 2023-08-25T09:39:34.096 INFO:teuthology.orchestra.run.smithi089.stdout:(81/154): uuid-1.6.2-55.el9.x86_64.rpm 235 kB/s | 56 kB 00:00 2023-08-25T09:39:34.129 INFO:teuthology.orchestra.run.smithi149.stdout:(7/154): ceph-mon-18.0.0-5703.gba6b39e4.el9.x86 10 MB/s | 4.4 MB 00:00 2023-08-25T09:39:34.130 INFO:teuthology.orchestra.run.smithi089.stdout:(82/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.4 MB/s | 85 kB 00:00 2023-08-25T09:39:34.154 INFO:teuthology.orchestra.run.smithi121.stdout:(16/154): libradosstriper1-18.0.0-5703.gba6b39e 6.2 MB/s | 473 kB 00:00 2023-08-25T09:39:34.155 INFO:teuthology.orchestra.run.smithi089.stdout:(83/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 753 kB/s | 63 kB 00:00 2023-08-25T09:39:34.188 INFO:teuthology.orchestra.run.smithi089.stdout:(84/154): fuse-2.9.9-15.el9.x86_64.rpm 857 kB/s | 79 kB 00:00 2023-08-25T09:39:34.223 INFO:teuthology.orchestra.run.smithi089.stdout:(85/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 2.9 MB/s | 197 kB 00:00 2023-08-25T09:39:34.256 INFO:teuthology.orchestra.run.smithi089.stdout:(86/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 7.9 MB/s | 807 kB 00:00 2023-08-25T09:39:34.298 INFO:teuthology.orchestra.run.smithi089.stdout:(87/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.2 MB/s | 241 kB 00:00 2023-08-25T09:39:34.348 INFO:teuthology.orchestra.run.smithi089.stdout:(88/154): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.1 MB 00:00 2023-08-25T09:39:34.381 INFO:teuthology.orchestra.run.smithi089.stdout:(89/154): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-08-25T09:39:34.415 INFO:teuthology.orchestra.run.smithi089.stdout:(90/154): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2023-08-25T09:39:34.599 INFO:teuthology.orchestra.run.smithi089.stdout:(91/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 246 kB/s | 45 kB 00:00 2023-08-25T09:39:34.671 INFO:teuthology.orchestra.run.smithi121.stdout:(17/154): librgw2-18.0.0-5703.gba6b39e4.el9.x86 9.0 MB/s | 4.7 MB 00:00 2023-08-25T09:39:34.708 INFO:teuthology.orchestra.run.smithi089.stdout:(92/154): python3-devel-3.9.16-1.el9.x86_64.rpm 688 kB/s | 247 kB 00:00 2023-08-25T09:39:34.739 INFO:teuthology.orchestra.run.smithi121.stdout:(18/154): python3-ceph-argparse-18.0.0-5703.gba 679 kB/s | 45 kB 00:00 2023-08-25T09:39:34.775 INFO:teuthology.orchestra.run.smithi089.stdout:(93/154): fmt-8.1.1-5.el9.x86_64.rpm 308 kB/s | 111 kB 00:00 2023-08-25T09:39:34.830 INFO:teuthology.orchestra.run.smithi121.stdout:(19/154): python3-ceph-common-18.0.0-5703.gba6b 1.3 MB/s | 127 kB 00:00 2023-08-25T09:39:34.858 INFO:teuthology.orchestra.run.smithi089.stdout:(94/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 428 kB/s | 24 kB 00:00 2023-08-25T09:39:34.914 INFO:teuthology.orchestra.run.smithi121.stdout:(20/154): python3-cephfs-18.0.0-5703.gba6b39e4. 1.9 MB/s | 161 kB 00:00 2023-08-25T09:39:34.925 INFO:teuthology.orchestra.run.smithi089.stdout:(95/154): liboath-2.6.7-2.el9.x86_64.rpm 746 kB/s | 49 kB 00:00 2023-08-25T09:39:35.014 INFO:teuthology.orchestra.run.smithi121.stdout:(21/154): python3-rados-18.0.0-5703.gba6b39e4.e 3.1 MB/s | 320 kB 00:00 2023-08-25T09:39:35.052 INFO:teuthology.orchestra.run.smithi089.stdout:(96/154): libunwind-1.6.2-1.el9.x86_64.rpm 530 kB/s | 67 kB 00:00 2023-08-25T09:39:35.098 INFO:teuthology.orchestra.run.smithi121.stdout:(22/154): python3-rbd-18.0.0-5703.gba6b39e4.el9 3.5 MB/s | 297 kB 00:00 2023-08-25T09:39:35.117 INFO:teuthology.orchestra.run.smithi089.stdout:(97/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 596 kB/s | 309 kB 00:00 2023-08-25T09:39:35.156 INFO:teuthology.orchestra.run.smithi121.stdout:(23/154): python3-rgw-18.0.0-5703.gba6b39e4.el9 1.7 MB/s | 99 kB 00:00 2023-08-25T09:39:35.171 INFO:teuthology.orchestra.run.smithi149.stdout:(8/154): ceph-radosgw-18.0.0-5703.gba6b39e4.el9 7.8 MB/s | 8.2 MB 00:01 2023-08-25T09:39:35.215 INFO:teuthology.orchestra.run.smithi121.stdout:(24/154): rbd-fuse-18.0.0-5703.gba6b39e4.el9.x8 1.4 MB/s | 85 kB 00:00 2023-08-25T09:39:35.230 INFO:teuthology.orchestra.run.smithi149.stdout:(9/154): ceph-selinux-18.0.0-5703.gba6b39e4.el9 417 kB/s | 24 kB 00:00 2023-08-25T09:39:35.467 INFO:teuthology.orchestra.run.smithi121.stdout:(25/154): ceph-common-18.0.0-5703.gba6b39e4.el9 3.6 MB/s | 19 MB 00:05 2023-08-25T09:39:35.476 INFO:teuthology.orchestra.run.smithi089.stdout:(98/154): python3-asyncssh-2.13.2-3.el9.noarch. 1.5 MB/s | 548 kB 00:00 2023-08-25T09:39:35.543 INFO:teuthology.orchestra.run.smithi089.stdout:(99/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.7 MB/s | 837 kB 00:00 2023-08-25T09:39:35.560 INFO:teuthology.orchestra.run.smithi089.stdout:(100/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2023-08-25T09:39:35.574 INFO:teuthology.orchestra.run.smithi121.stdout:(26/154): rbd-mirror-18.0.0-5703.gba6b39e4.el9. 8.4 MB/s | 3.0 MB 00:00 2023-08-25T09:39:35.619 INFO:teuthology.orchestra.run.smithi089.stdout:(101/154): python3-cachetools-4.2.4-1.el9.noarc 426 kB/s | 32 kB 00:00 2023-08-25T09:39:35.633 INFO:teuthology.orchestra.run.smithi121.stdout:(27/154): rbd-nbd-18.0.0-5703.gba6b39e4.el9.x86 1.0 MB/s | 169 kB 00:00 2023-08-25T09:39:35.635 INFO:teuthology.orchestra.run.smithi089.stdout:(102/154): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2023-08-25T09:39:35.658 INFO:teuthology.orchestra.run.smithi121.stdout:(28/154): ceph-grafana-dashboards-18.0.0-5703.g 278 kB/s | 23 kB 00:00 2023-08-25T09:39:35.742 INFO:teuthology.orchestra.run.smithi121.stdout:(29/154): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 1.2 MB/s | 132 kB 00:00 2023-08-25T09:39:35.761 INFO:teuthology.orchestra.run.smithi089.stdout:(103/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-08-25T09:39:35.894 INFO:teuthology.orchestra.run.smithi089.stdout:(104/154): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2023-08-25T09:39:35.900 INFO:teuthology.orchestra.run.smithi121.stdout:(30/154): ceph-mgr-dashboard-18.0.0-5703.gba6b3 7.2 MB/s | 1.7 MB 00:00 2023-08-25T09:39:35.928 INFO:teuthology.orchestra.run.smithi089.stdout:(105/154): python3-google-auth-2.22.0-1.el9.noa 1.2 MB/s | 197 kB 00:00 2023-08-25T09:39:35.953 INFO:teuthology.orchestra.run.smithi089.stdout:(106/154): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2023-08-25T09:39:35.967 INFO:teuthology.orchestra.run.smithi121.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5703.gba 3.5 MB/s | 242 kB 00:00 2023-08-25T09:39:35.995 INFO:teuthology.orchestra.run.smithi089.stdout:(107/154): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2023-08-25T09:39:36.018 INFO:teuthology.orchestra.run.smithi121.stdout:(32/154): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 951 kB/s | 47 kB 00:00 2023-08-25T09:39:36.020 INFO:teuthology.orchestra.run.smithi089.stdout:(108/154): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2023-08-25T09:39:36.054 INFO:teuthology.orchestra.run.smithi089.stdout:(109/154): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2023-08-25T09:39:36.068 INFO:teuthology.orchestra.run.smithi121.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5703.gb 294 kB/s | 15 kB 00:00 2023-08-25T09:39:36.072 INFO:teuthology.orchestra.run.smithi149.stdout:(10/154): ceph-osd-18.0.0-5703.gba6b39e4.el9.x8 7.9 MB/s | 18 MB 00:02 2023-08-25T09:39:36.088 INFO:teuthology.orchestra.run.smithi089.stdout:(110/154): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2023-08-25T09:39:36.113 INFO:teuthology.orchestra.run.smithi089.stdout:(111/154): python3-jwt+crypto-2.4.0-1.el9.noarc 155 kB/s | 9.0 kB 00:00 2023-08-25T09:39:36.155 INFO:teuthology.orchestra.run.smithi089.stdout:(112/154): python3-jwt-2.4.0-1.el9.noarch.rpm 612 kB/s | 41 kB 00:00 2023-08-25T09:39:36.160 INFO:teuthology.orchestra.run.smithi121.stdout:(34/154): ceph-volume-18.0.0-5703.gba6b39e4.el9 2.8 MB/s | 261 kB 00:00 2023-08-25T09:39:36.180 INFO:teuthology.orchestra.run.smithi149.stdout:(11/154): cephfs-mirror-18.0.0-5703.gba6b39e4.e 2.0 MB/s | 218 kB 00:00 2023-08-25T09:39:36.213 INFO:teuthology.orchestra.run.smithi089.stdout:(113/154): python3-logutils-0.3.5-21.el9.noarch 795 kB/s | 46 kB 00:00 2023-08-25T09:39:36.227 INFO:teuthology.orchestra.run.smithi121.stdout:(35/154): cephadm-18.0.0-5703.gba6b39e4.el9.noa 3.3 MB/s | 225 kB 00:00 2023-08-25T09:39:36.231 INFO:teuthology.orchestra.run.smithi149.stdout:(12/154): libcephfs-devel-18.0.0-5703.gba6b39e4 636 kB/s | 31 kB 00:00 2023-08-25T09:39:36.277 INFO:teuthology.orchestra.run.smithi121.stdout:(36/154): cephfs-top-18.0.0-5703.gba6b39e4.el9. 363 kB/s | 18 kB 00:00 2023-08-25T09:39:36.289 INFO:teuthology.orchestra.run.smithi089.stdout:(114/154): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2023-08-25T09:39:36.356 INFO:teuthology.orchestra.run.smithi089.stdout:(115/154): python3-natsort-7.1.1-5.el9.noarch.r 866 kB/s | 58 kB 00:00 2023-08-25T09:39:36.364 INFO:teuthology.orchestra.run.smithi149.stdout:(13/154): libcephfs2-18.0.0-5703.gba6b39e4.el9. 4.9 MB/s | 667 kB 00:00 2023-08-25T09:39:36.423 INFO:teuthology.orchestra.run.smithi149.stdout:(14/154): libcephsqlite-18.0.0-5703.gba6b39e4.e 2.8 MB/s | 164 kB 00:00 2023-08-25T09:39:36.436 INFO:teuthology.orchestra.run.smithi121.stdout:(37/154): automake-1.16.2-8.el9.noarch.rpm 4.1 MB/s | 662 kB 00:00 2023-08-25T09:39:36.490 INFO:teuthology.orchestra.run.smithi149.stdout:(15/154): librados-devel-18.0.0-5703.gba6b39e4. 1.9 MB/s | 126 kB 00:00 2023-08-25T09:39:36.520 INFO:teuthology.orchestra.run.smithi121.stdout:(38/154): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 920 kB 00:00 2023-08-25T09:39:36.574 INFO:teuthology.orchestra.run.smithi149.stdout:(16/154): libradosstriper1-18.0.0-5703.gba6b39e 5.6 MB/s | 473 kB 00:00 2023-08-25T09:39:36.578 INFO:teuthology.orchestra.run.smithi121.stdout:(39/154): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-08-25T09:39:36.581 INFO:teuthology.orchestra.run.smithi089.stdout:(116/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2023-08-25T09:39:36.612 INFO:teuthology.orchestra.run.smithi121.stdout:(40/154): elfutils-libelf-devel-0.189-3.el9.x86 635 kB/s | 21 kB 00:00 2023-08-25T09:39:36.656 INFO:teuthology.orchestra.run.smithi089.stdout:(117/154): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2023-08-25T09:39:36.662 INFO:teuthology.orchestra.run.smithi121.stdout:(41/154): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-08-25T09:39:36.696 INFO:teuthology.orchestra.run.smithi121.stdout:(42/154): flexiblas-3.0.4-8.el9.x86_64.rpm 953 kB/s | 32 kB 00:00 2023-08-25T09:39:36.781 INFO:teuthology.orchestra.run.smithi089.stdout:(118/154): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2023-08-25T09:39:36.815 INFO:teuthology.orchestra.run.smithi089.stdout:(119/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 568 kB/s | 90 kB 00:00 2023-08-25T09:39:36.830 INFO:teuthology.orchestra.run.smithi121.stdout:(43/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2023-08-25T09:39:36.840 INFO:teuthology.orchestra.run.smithi089.stdout:(120/154): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2023-08-25T09:39:36.855 INFO:teuthology.orchestra.run.smithi121.stdout:(44/154): flexiblas-openblas-openmp-3.0.4-8.el9 690 kB/s | 17 kB 00:00 2023-08-25T09:39:36.899 INFO:teuthology.orchestra.run.smithi089.stdout:(121/154): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-08-25T09:39:36.924 INFO:teuthology.orchestra.run.smithi121.stdout:(45/154): jq-1.6-15.el9.x86_64.rpm 2.6 MB/s | 186 kB 00:00 2023-08-25T09:39:36.966 INFO:teuthology.orchestra.run.smithi089.stdout:(122/154): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-08-25T09:39:36.989 INFO:teuthology.orchestra.run.smithi121.stdout:(46/154): libaio-devel-0.3.111-13.el9.x86_64.rp 155 kB/s | 10 kB 00:00 2023-08-25T09:39:36.991 INFO:teuthology.orchestra.run.smithi089.stdout:(123/154): python3-tempora-5.0.0-2.el9.noarch.r 390 kB/s | 36 kB 00:00 2023-08-25T09:39:37.039 INFO:teuthology.orchestra.run.smithi121.stdout:(47/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-08-25T09:39:37.043 INFO:teuthology.orchestra.run.smithi089.stdout:(124/154): python3-typing-extensions-4.4.0-2.el 666 kB/s | 51 kB 00:00 2023-08-25T09:39:37.081 INFO:teuthology.orchestra.run.smithi121.stdout:(48/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-08-25T09:39:37.116 INFO:teuthology.orchestra.run.smithi149.stdout:(17/154): librgw2-18.0.0-5703.gba6b39e4.el9.x86 8.6 MB/s | 4.7 MB 00:00 2023-08-25T09:39:37.148 INFO:teuthology.orchestra.run.smithi121.stdout:(49/154): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2023-08-25T09:39:37.159 INFO:teuthology.orchestra.run.smithi089.stdout:(125/154): python3-websocket-client-1.2.3-2.el9 776 kB/s | 90 kB 00:00 2023-08-25T09:39:37.166 INFO:teuthology.orchestra.run.smithi149.stdout:(18/154): python3-ceph-argparse-18.0.0-5703.gba 924 kB/s | 45 kB 00:00 2023-08-25T09:39:37.192 INFO:teuthology.orchestra.run.smithi089.stdout:(126/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2023-08-25T09:39:37.215 INFO:teuthology.orchestra.run.smithi121.stdout:(50/154): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2023-08-25T09:39:37.241 INFO:teuthology.orchestra.run.smithi149.stdout:(19/154): python3-ceph-common-18.0.0-5703.gba6b 1.7 MB/s | 127 kB 00:00 2023-08-25T09:39:37.249 INFO:teuthology.orchestra.run.smithi121.stdout:(51/154): libuuid-devel-2.37.4-14.el9.x86_64.rp 737 kB/s | 24 kB 00:00 2023-08-25T09:39:37.251 INFO:teuthology.orchestra.run.smithi089.stdout:(127/154): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2023-08-25T09:39:37.291 INFO:teuthology.orchestra.run.smithi121.stdout:(52/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2023-08-25T09:39:37.317 INFO:teuthology.orchestra.run.smithi149.stdout:(20/154): python3-cephfs-18.0.0-5703.gba6b39e4. 2.1 MB/s | 161 kB 00:00 2023-08-25T09:39:37.341 INFO:teuthology.orchestra.run.smithi121.stdout:(53/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-08-25T09:39:37.392 INFO:teuthology.orchestra.run.smithi149.stdout:(21/154): python3-rados-18.0.0-5703.gba6b39e4.e 4.2 MB/s | 320 kB 00:00 2023-08-25T09:39:37.401 INFO:teuthology.orchestra.run.smithi089.stdout:(128/154): re2-20211101-2.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-08-25T09:39:37.417 INFO:teuthology.orchestra.run.smithi121.stdout:(54/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-08-25T09:39:37.458 INFO:teuthology.orchestra.run.smithi121.stdout:(55/154): openblas-0.3.21-2.el9.x86_64.rpm 820 kB/s | 34 kB 00:00 2023-08-25T09:39:37.484 INFO:teuthology.orchestra.run.smithi149.stdout:(22/154): python3-rbd-18.0.0-5703.gba6b39e4.el9 3.2 MB/s | 297 kB 00:00 2023-08-25T09:39:37.518 INFO:teuthology.orchestra.run.smithi089.stdout:(129/154): libarrow-9.0.0-9.el9.x86_64.rpm 1.6 MB/s | 4.4 MB 00:02 2023-08-25T09:39:37.551 INFO:teuthology.orchestra.run.smithi149.stdout:(23/154): python3-rgw-18.0.0-5703.gba6b39e4.el9 1.5 MB/s | 99 kB 00:00 2023-08-25T09:39:37.552 INFO:teuthology.orchestra.run.smithi089.stdout:(130/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2023-08-25T09:39:37.584 INFO:teuthology.orchestra.run.smithi121.stdout:(56/154): ceph-mgr-diskprediction-local-18.0.0- 4.0 MB/s | 7.4 MB 00:01 2023-08-25T09:39:37.609 INFO:teuthology.orchestra.run.smithi149.stdout:(24/154): rbd-fuse-18.0.0-5703.gba6b39e4.el9.x8 1.5 MB/s | 85 kB 00:00 2023-08-25T09:39:37.692 INFO:teuthology.orchestra.run.smithi121.stdout:(57/154): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-08-25T09:39:37.768 INFO:teuthology.orchestra.run.smithi121.stdout:(58/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2023-08-25T09:39:37.845 INFO:teuthology.orchestra.run.smithi121.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2023-08-25T09:39:37.894 INFO:teuthology.orchestra.run.smithi121.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 6.4 MB/s | 811 kB 00:00 2023-08-25T09:39:37.927 INFO:teuthology.orchestra.run.smithi121.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 134 kB 00:00 2023-08-25T09:39:38.102 INFO:teuthology.orchestra.run.smithi121.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2023-08-25T09:39:38.135 INFO:teuthology.orchestra.run.smithi149.stdout:(25/154): rbd-mirror-18.0.0-5703.gba6b39e4.el9. 5.8 MB/s | 3.0 MB 00:00 2023-08-25T09:39:38.169 INFO:teuthology.orchestra.run.smithi089.stdout:(131/154): librbd1-18.0.0-5703.gba6b39e4.el9.x8 4.9 MB/s | 3.0 MB 00:00 2023-08-25T09:39:38.193 INFO:teuthology.orchestra.run.smithi149.stdout:(26/154): rbd-nbd-18.0.0-5703.gba6b39e4.el9.x86 2.9 MB/s | 169 kB 00:00 2023-08-25T09:39:38.228 INFO:teuthology.orchestra.run.smithi089.stdout:(132/154): librados2-18.0.0-5703.gba6b39e4.el9. 4.6 MB/s | 3.3 MB 00:00 2023-08-25T09:39:38.244 INFO:teuthology.orchestra.run.smithi149.stdout:(27/154): ceph-grafana-dashboards-18.0.0-5703.g 473 kB/s | 23 kB 00:00 2023-08-25T09:39:38.279 INFO:teuthology.orchestra.run.smithi121.stdout:(63/154): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-08-25T09:39:38.286 INFO:teuthology.orchestra.run.smithi089.stdout:(133/154): NetworkManager-1.44.0-2.el9.x86_64.r 19 MB/s | 2.2 MB 00:00 2023-08-25T09:39:38.311 INFO:teuthology.orchestra.run.smithi149.stdout:(28/154): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 2.0 MB/s | 132 kB 00:00 2023-08-25T09:39:38.311 INFO:teuthology.orchestra.run.smithi121.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.1 MB/s | 228 kB 00:00 2023-08-25T09:39:38.337 INFO:teuthology.orchestra.run.smithi089.stdout:(134/154): NetworkManager-libnm-1.44.0-2.el9.x8 17 MB/s | 1.8 MB 00:00 2023-08-25T09:39:38.337 INFO:teuthology.orchestra.run.smithi121.stdout:(65/154): python3-jsonpatch-1.21-16.el9.noarch. 419 kB/s | 24 kB 00:00 2023-08-25T09:39:38.362 INFO:teuthology.orchestra.run.smithi121.stdout:(66/154): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2023-08-25T09:39:38.362 INFO:teuthology.orchestra.run.smithi089.stdout:(135/154): NetworkManager-team-1.44.0-2.el9.x86 563 kB/s | 41 kB 00:00 2023-08-25T09:39:38.395 INFO:teuthology.orchestra.run.smithi089.stdout:(136/154): NetworkManager-tui-1.44.0-2.el9.x86_ 4.1 MB/s | 245 kB 00:00 2023-08-25T09:39:38.404 INFO:teuthology.orchestra.run.smithi121.stdout:(67/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-08-25T09:39:38.412 INFO:teuthology.orchestra.run.smithi089.stdout:(137/154): elfutils-debuginfod-client-0.189-3.e 722 kB/s | 36 kB 00:00 2023-08-25T09:39:38.429 INFO:teuthology.orchestra.run.smithi121.stdout:(68/154): python3-markupsafe-1.1.1-12.el9.x86_6 473 kB/s | 32 kB 00:00 2023-08-25T09:39:38.446 INFO:teuthology.orchestra.run.smithi089.stdout:(138/154): elfutils-libelf-0.189-3.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-08-25T09:39:38.480 INFO:teuthology.orchestra.run.smithi089.stdout:(139/154): elfutils-libs-0.189-3.el9.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2023-08-25T09:39:38.519 INFO:teuthology.orchestra.run.smithi149.stdout:(29/154): ceph-mgr-dashboard-18.0.0-5703.gba6b3 8.4 MB/s | 1.7 MB 00:00 2023-08-25T09:39:38.538 INFO:teuthology.orchestra.run.smithi089.stdout:(140/154): iproute-6.2.0-5.el9.x86_64.rpm 8.4 MB/s | 785 kB 00:00 2023-08-25T09:39:38.593 INFO:teuthology.orchestra.run.smithi089.stdout:(141/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 3.9 MB/s | 448 kB 00:00 2023-08-25T09:39:38.604 INFO:teuthology.orchestra.run.smithi121.stdout:(69/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-08-25T09:39:38.630 INFO:teuthology.orchestra.run.smithi089.stdout:(142/154): libblkid-2.37.4-14.el9.x86_64.rpm 1.1 MB/s | 107 kB 00:00 2023-08-25T09:39:38.664 INFO:teuthology.orchestra.run.smithi089.stdout:(143/154): libfdisk-2.37.4-14.el9.x86_64.rpm 2.1 MB/s | 154 kB 00:00 2023-08-25T09:39:38.671 INFO:teuthology.orchestra.run.smithi121.stdout:(70/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 901 kB/s | 217 kB 00:00 2023-08-25T09:39:38.698 INFO:teuthology.orchestra.run.smithi089.stdout:(144/154): libmount-2.37.4-14.el9.x86_64.rpm 1.9 MB/s | 133 kB 00:00 2023-08-25T09:39:38.705 INFO:teuthology.orchestra.run.smithi121.stdout:(71/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 174 kB 00:00 2023-08-25T09:39:38.723 INFO:teuthology.orchestra.run.smithi089.stdout:(145/154): libsmartcols-2.37.4-14.el9.x86_64.rp 1.1 MB/s | 63 kB 00:00 2023-08-25T09:39:38.730 INFO:teuthology.orchestra.run.smithi121.stdout:(72/154): python3-prettytable-0.7.2-27.el9.noar 704 kB/s | 41 kB 00:00 2023-08-25T09:39:38.749 INFO:teuthology.orchestra.run.smithi089.stdout:(146/154): libuuid-2.37.4-14.el9.x86_64.rpm 558 kB/s | 28 kB 00:00 2023-08-25T09:39:38.764 INFO:teuthology.orchestra.run.smithi121.stdout:(73/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-08-25T09:39:38.790 INFO:teuthology.orchestra.run.smithi089.stdout:(147/154): thrift-0.15.0-2.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2023-08-25T09:39:38.806 INFO:teuthology.orchestra.run.smithi121.stdout:(74/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-08-25T09:39:38.823 INFO:teuthology.orchestra.run.smithi121.stdout:(75/154): python3-pytz-2021.1-5.el9.noarch.rpm 814 kB/s | 47 kB 00:00 2023-08-25T09:39:38.849 INFO:teuthology.orchestra.run.smithi089.stdout:(148/154): openssl-3.0.7-24.el9.x86_64.rpm 9.2 MB/s | 1.2 MB 00:00 2023-08-25T09:39:38.856 INFO:teuthology.orchestra.run.smithi121.stdout:(76/154): python3-requests-oauthlib-1.3.0-12.el 858 kB/s | 43 kB 00:00 2023-08-25T09:39:38.908 INFO:teuthology.orchestra.run.smithi089.stdout:(149/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2023-08-25T09:39:38.975 INFO:teuthology.orchestra.run.smithi089.stdout:(150/154): util-linux-2.37.4-14.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2023-08-25T09:39:39.008 INFO:teuthology.orchestra.run.smithi089.stdout:(151/154): util-linux-core-2.37.4-14.el9.x86_64 2.7 MB/s | 433 kB 00:00 2023-08-25T09:39:39.034 INFO:teuthology.orchestra.run.smithi089.stdout:(152/154): util-linux-user-2.37.4-14.el9.x86_64 243 kB/s | 30 kB 00:00 2023-08-25T09:39:39.067 INFO:teuthology.orchestra.run.smithi089.stdout:(153/154): xfsdump-3.1.12-3.el9.x86_64.rpm 3.4 MB/s | 321 kB 00:00 2023-08-25T09:39:39.142 INFO:teuthology.orchestra.run.smithi089.stdout:(154/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 9.8 MB/s | 1.0 MB 00:00 2023-08-25T09:39:39.150 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-08-25T09:39:39.150 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 206 MB 00:13 2023-08-25T09:39:39.153 INFO:teuthology.orchestra.run.smithi149.stdout:(30/154): ceph-test-18.0.0-5703.gba6b39e4.el9.x 10 MB/s | 40 MB 00:03 2023-08-25T09:39:39.182 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-08-25T09:39:39.228 INFO:teuthology.orchestra.run.smithi149.stdout:(31/154): ceph-mgr-modules-core-18.0.0-5703.gba 3.2 MB/s | 242 kB 00:00 2023-08-25T09:39:39.271 INFO:teuthology.orchestra.run.smithi149.stdout:(32/154): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 1.1 MB/s | 47 kB 00:00 2023-08-25T09:39:39.312 INFO:teuthology.orchestra.run.smithi149.stdout:(33/154): ceph-prometheus-alerts-18.0.0-5703.gb 360 kB/s | 15 kB 00:00 2023-08-25T09:39:39.404 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-08-25T09:39:39.404 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-08-25T09:39:39.446 INFO:teuthology.orchestra.run.smithi149.stdout:(34/154): ceph-mgr-diskprediction-local-18.0.0- 8.0 MB/s | 7.4 MB 00:00 2023-08-25T09:39:39.488 INFO:teuthology.orchestra.run.smithi149.stdout:(35/154): ceph-volume-18.0.0-5703.gba6b39e4.el9 1.5 MB/s | 261 kB 00:00 2023-08-25T09:39:39.515 INFO:teuthology.orchestra.run.smithi121.stdout:(77/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2023-08-25T09:39:39.530 INFO:teuthology.orchestra.run.smithi149.stdout:(36/154): cephadm-18.0.0-5703.gba6b39e4.el9.noa 2.7 MB/s | 225 kB 00:00 2023-08-25T09:39:39.532 INFO:teuthology.orchestra.run.smithi121.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 57 kB/s | 39 kB 00:00 2023-08-25T09:39:39.564 INFO:teuthology.orchestra.run.smithi149.stdout:(37/154): cephfs-top-18.0.0-5703.gba6b39e4.el9. 243 kB/s | 18 kB 00:00 2023-08-25T09:39:39.582 INFO:teuthology.orchestra.run.smithi121.stdout:(79/154): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2023-08-25T09:39:39.599 INFO:teuthology.orchestra.run.smithi121.stdout:(80/154): uuid-1.6.2-55.el9.x86_64.rpm 840 kB/s | 56 kB 00:00 2023-08-25T09:39:39.633 INFO:teuthology.orchestra.run.smithi121.stdout:(81/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-08-25T09:39:39.658 INFO:teuthology.orchestra.run.smithi121.stdout:(82/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2023-08-25T09:39:39.692 INFO:teuthology.orchestra.run.smithi121.stdout:(83/154): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-08-25T09:39:39.751 INFO:teuthology.orchestra.run.smithi121.stdout:(84/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 8.6 MB/s | 807 kB 00:00 2023-08-25T09:39:39.784 INFO:teuthology.orchestra.run.smithi121.stdout:(85/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 2.1 MB/s | 197 kB 00:00 2023-08-25T09:39:39.826 INFO:teuthology.orchestra.run.smithi121.stdout:(86/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2023-08-25T09:39:39.856 INFO:teuthology.orchestra.run.smithi149.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2023-08-25T09:39:39.906 INFO:teuthology.orchestra.run.smithi149.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 920 kB 00:00 2023-08-25T09:39:39.917 INFO:teuthology.orchestra.run.smithi121.stdout:(87/154): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.1 MB 00:00 2023-08-25T09:39:39.940 INFO:teuthology.orchestra.run.smithi149.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2023-08-25T09:39:39.952 INFO:teuthology.orchestra.run.smithi121.stdout:(88/154): python3-ply-3.11-14.el9.noarch.rpm 827 kB/s | 103 kB 00:00 2023-08-25T09:39:39.965 INFO:teuthology.orchestra.run.smithi149.stdout:(41/154): elfutils-libelf-devel-0.189-3.el9.x86 375 kB/s | 21 kB 00:00 2023-08-25T09:39:39.986 INFO:teuthology.orchestra.run.smithi121.stdout:(89/154): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 124 kB 00:00 2023-08-25T09:39:40.031 INFO:teuthology.orchestra.run.smithi149.stdout:(42/154): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 307 kB 00:00 2023-08-25T09:39:40.066 INFO:teuthology.orchestra.run.smithi149.stdout:(43/154): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 32 kB 00:00 2023-08-25T09:39:40.191 INFO:teuthology.orchestra.run.smithi149.stdout:(44/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2023-08-25T09:39:40.216 INFO:teuthology.orchestra.run.smithi149.stdout:(45/154): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 17 kB 00:00 2023-08-25T09:39:40.241 INFO:teuthology.orchestra.run.smithi149.stdout:(46/154): libaio-devel-0.3.111-13.el9.x86_64.rp 426 kB/s | 10 kB 00:00 2023-08-25T09:39:40.275 INFO:teuthology.orchestra.run.smithi149.stdout:(47/154): jq-1.6-15.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-08-25T09:39:40.317 INFO:teuthology.orchestra.run.smithi149.stdout:(48/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-08-25T09:39:40.342 INFO:teuthology.orchestra.run.smithi149.stdout:(49/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 685 kB/s | 44 kB 00:00 2023-08-25T09:39:40.393 INFO:teuthology.orchestra.run.smithi149.stdout:(50/154): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2023-08-25T09:39:40.443 INFO:teuthology.orchestra.run.smithi149.stdout:(51/154): libtool-2.4.6-45.el9.x86_64.rpm 6.1 MB/s | 578 kB 00:00 2023-08-25T09:39:40.468 INFO:teuthology.orchestra.run.smithi149.stdout:(52/154): libuuid-devel-2.37.4-14.el9.x86_64.rp 357 kB/s | 24 kB 00:00 2023-08-25T09:39:40.493 INFO:teuthology.orchestra.run.smithi149.stdout:(53/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 46 kB 00:00 2023-08-25T09:39:40.527 INFO:teuthology.orchestra.run.smithi149.stdout:(54/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-08-25T09:39:40.561 INFO:teuthology.orchestra.run.smithi149.stdout:(55/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.4 MB/s | 217 kB 00:00 2023-08-25T09:39:40.586 INFO:teuthology.orchestra.run.smithi149.stdout:(56/154): openblas-0.3.21-2.el9.x86_64.rpm 614 kB/s | 34 kB 00:00 2023-08-25T09:39:40.711 INFO:teuthology.orchestra.run.smithi121.stdout:(90/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 62 kB/s | 45 kB 00:00 2023-08-25T09:39:40.750 INFO:teuthology.orchestra.run.smithi149.stdout:(57/154): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-08-25T09:39:40.845 INFO:teuthology.orchestra.run.smithi149.stdout:(58/154): openssl-devel-3.0.7-24.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-08-25T09:39:40.911 INFO:teuthology.orchestra.run.smithi121.stdout:(91/154): python3-devel-3.9.16-1.el9.x86_64.rpm 258 kB/s | 247 kB 00:00 2023-08-25T09:39:40.921 INFO:teuthology.orchestra.run.smithi149.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 9.5 MB/s | 1.5 MB 00:00 2023-08-25T09:39:40.939 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-08-25T09:39:40.940 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-08-25T09:39:40.971 INFO:teuthology.orchestra.run.smithi149.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 7.2 MB/s | 811 kB 00:00 2023-08-25T09:39:41.005 INFO:teuthology.orchestra.run.smithi149.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 1.8 MB/s | 134 kB 00:00 2023-08-25T09:39:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 29 MB/s | 5.7 MB 00:00 2023-08-25T09:39:41.339 INFO:teuthology.orchestra.run.smithi149.stdout:(63/154): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-08-25T09:39:41.372 INFO:teuthology.orchestra.run.smithi149.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-08-25T09:39:41.406 INFO:teuthology.orchestra.run.smithi149.stdout:(65/154): python3-jsonpatch-1.21-16.el9.noarch. 761 kB/s | 24 kB 00:00 2023-08-25T09:39:41.422 INFO:teuthology.orchestra.run.smithi149.stdout:(66/154): python3-jsonpointer-2.0-4.el9.noarch. 372 kB/s | 18 kB 00:00 2023-08-25T09:39:41.436 INFO:teuthology.orchestra.run.smithi121.stdout:(92/154): fmt-8.1.1-5.el9.x86_64.rpm 153 kB/s | 111 kB 00:00 2023-08-25T09:39:41.456 INFO:teuthology.orchestra.run.smithi149.stdout:(67/154): python3-markupsafe-1.1.1-12.el9.x86_6 990 kB/s | 32 kB 00:00 2023-08-25T09:39:41.490 INFO:teuthology.orchestra.run.smithi149.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-08-25T09:39:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:(69/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 4.8 MB 00:00 2023-08-25T09:39:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:(70/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-08-25T09:39:41.699 INFO:teuthology.orchestra.run.smithi149.stdout:(71/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-08-25T09:39:41.724 INFO:teuthology.orchestra.run.smithi149.stdout:(72/154): python3-prettytable-0.7.2-27.el9.noar 638 kB/s | 41 kB 00:00 2023-08-25T09:39:41.758 INFO:teuthology.orchestra.run.smithi149.stdout:(73/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-08-25T09:39:41.792 INFO:teuthology.orchestra.run.smithi149.stdout:(74/154): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 211 kB 00:00 2023-08-25T09:39:41.817 INFO:teuthology.orchestra.run.smithi149.stdout:(75/154): python3-pytz-2021.1-5.el9.noarch.rpm 850 kB/s | 47 kB 00:00 2023-08-25T09:39:41.842 INFO:teuthology.orchestra.run.smithi149.stdout:(76/154): python3-requests-oauthlib-1.3.0-12.el 876 kB/s | 43 kB 00:00 2023-08-25T09:39:41.845 INFO:teuthology.orchestra.run.smithi121.stdout:(93/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 331 kB/s | 309 kB 00:00 2023-08-25T09:39:42.010 INFO:teuthology.orchestra.run.smithi121.stdout:(94/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 148 kB/s | 24 kB 00:00 2023-08-25T09:39:42.196 INFO:teuthology.orchestra.run.smithi121.stdout:(95/154): liboath-2.6.7-2.el9.x86_64.rpm 261 kB/s | 49 kB 00:00 2023-08-25T09:39:42.226 INFO:teuthology.orchestra.run.smithi149.stdout:(77/154): python3-toml-0.10.2-6.el9.noarch.rpm 106 kB/s | 39 kB 00:00 2023-08-25T09:39:42.321 INFO:teuthology.orchestra.run.smithi121.stdout:(96/154): libunwind-1.6.2-1.el9.x86_64.rpm 539 kB/s | 67 kB 00:00 2023-08-25T09:39:42.435 INFO:teuthology.orchestra.run.smithi149.stdout:(78/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2023-08-25T09:39:42.469 INFO:teuthology.orchestra.run.smithi149.stdout:(79/154): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2023-08-25T09:39:42.494 INFO:teuthology.orchestra.run.smithi149.stdout:(80/154): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-08-25T09:39:42.527 INFO:teuthology.orchestra.run.smithi149.stdout:(81/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-08-25T09:39:42.575 INFO:teuthology.orchestra.run.smithi149.stdout:(82/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 794 kB/s | 63 kB 00:00 2023-08-25T09:39:42.604 INFO:teuthology.orchestra.run.smithi149.stdout:(83/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-08-25T09:39:42.653 INFO:teuthology.orchestra.run.smithi149.stdout:(84/154): libgfortran-11.4.1-2.1.el9.x86_64.rpm 10 MB/s | 807 kB 00:00 2023-08-25T09:39:42.698 INFO:teuthology.orchestra.run.smithi149.stdout:(85/154): libquadmath-11.4.1-2.1.el9.x86_64.rpm 2.3 MB/s | 197 kB 00:00 2023-08-25T09:39:42.740 INFO:teuthology.orchestra.run.smithi149.stdout:(86/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2023-08-25T09:39:42.798 INFO:teuthology.orchestra.run.smithi149.stdout:(87/154): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2023-08-25T09:39:42.832 INFO:teuthology.orchestra.run.smithi149.stdout:(88/154): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-08-25T09:39:42.857 INFO:teuthology.orchestra.run.smithi149.stdout:(89/154): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2023-08-25T09:39:42.924 INFO:teuthology.orchestra.run.smithi149.stdout:(90/154): zlib-devel-1.2.11-36.el9.x86_64.rpm 686 kB/s | 45 kB 00:00 2023-08-25T09:39:42.974 INFO:teuthology.orchestra.run.smithi149.stdout:(91/154): python3-devel-3.9.16-1.el9.x86_64.rpm 1.7 MB/s | 247 kB 00:00 2023-08-25T09:39:43.317 INFO:teuthology.orchestra.run.smithi149.stdout:(92/154): ceph-common-18.0.0-5703.gba6b39e4.el9 1.7 MB/s | 19 MB 00:10 2023-08-25T09:39:43.508 INFO:teuthology.orchestra.run.smithi149.stdout:(93/154): fmt-8.1.1-5.el9.x86_64.rpm 190 kB/s | 111 kB 00:00 2023-08-25T09:39:43.613 INFO:teuthology.orchestra.run.smithi121.stdout:(97/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 648 kB/s | 837 kB 00:01 2023-08-25T09:39:43.633 INFO:teuthology.orchestra.run.smithi149.stdout:(94/154): libarrow-doc-9.0.0-9.el9.noarch.rpm 196 kB/s | 24 kB 00:00 2023-08-25T09:39:43.743 INFO:teuthology.orchestra.run.smithi149.stdout:(95/154): liboath-2.6.7-2.el9.x86_64.rpm 450 kB/s | 49 kB 00:00 2023-08-25T09:39:43.859 INFO:teuthology.orchestra.run.smithi149.stdout:(96/154): libunwind-1.6.2-1.el9.x86_64.rpm 580 kB/s | 67 kB 00:00 2023-08-25T09:39:43.901 INFO:teuthology.orchestra.run.smithi149.stdout:(97/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 334 kB/s | 309 kB 00:00 2023-08-25T09:39:44.118 INFO:teuthology.orchestra.run.smithi149.stdout:(98/154): python3-asyncssh-2.13.2-3.el9.noarch. 2.5 MB/s | 548 kB 00:00 2023-08-25T09:39:44.235 INFO:teuthology.orchestra.run.smithi149.stdout:(99/154): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 373 kB/s | 43 kB 00:00 2023-08-25T09:39:44.335 INFO:teuthology.orchestra.run.smithi149.stdout:(100/154): libarrow-9.0.0-9.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2023-08-25T09:39:44.360 INFO:teuthology.orchestra.run.smithi149.stdout:(101/154): python3-cachetools-4.2.4-1.el9.noarc 258 kB/s | 32 kB 00:00 2023-08-25T09:39:44.470 INFO:teuthology.orchestra.run.smithi149.stdout:(102/154): python3-certifi-2021.10.8-2.el9.noar 113 kB/s | 15 kB 00:00 2023-08-25T09:39:44.472 INFO:teuthology.orchestra.run.smithi121.stdout:(98/154): python3-asyncssh-2.13.2-3.el9.noarch. 638 kB/s | 548 kB 00:00 2023-08-25T09:39:44.503 INFO:teuthology.orchestra.run.smithi149.stdout:(103/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-08-25T09:39:44.597 INFO:teuthology.orchestra.run.smithi121.stdout:(99/154): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 348 kB/s | 43 kB 00:00 2023-08-25T09:39:44.611 INFO:teuthology.orchestra.run.smithi149.stdout:(104/154): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2023-08-25T09:39:44.653 INFO:teuthology.orchestra.run.smithi149.stdout:(105/154): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.0 MB/s | 837 kB 00:00 2023-08-25T09:39:44.687 INFO:teuthology.orchestra.run.smithi149.stdout:(106/154): python3-google-auth-2.22.0-1.el9.noa 1.0 MB/s | 197 kB 00:00 2023-08-25T09:39:44.712 INFO:teuthology.orchestra.run.smithi149.stdout:(107/154): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-08-25T09:39:44.714 INFO:teuthology.orchestra.run.smithi121.stdout:(100/154): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2023-08-25T09:39:44.754 INFO:teuthology.orchestra.run.smithi149.stdout:(108/154): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2023-08-25T09:39:44.788 INFO:teuthology.orchestra.run.smithi149.stdout:(109/154): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2023-08-25T09:39:44.813 INFO:teuthology.orchestra.run.smithi149.stdout:(110/154): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-08-25T09:39:44.831 INFO:teuthology.orchestra.run.smithi121.stdout:(101/154): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2023-08-25T09:39:44.855 INFO:teuthology.orchestra.run.smithi149.stdout:(111/154): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2023-08-25T09:39:44.897 INFO:teuthology.orchestra.run.smithi149.stdout:(112/154): python3-jwt+crypto-2.4.0-1.el9.noarc 83 kB/s | 9.0 kB 00:00 2023-08-25T09:39:44.922 INFO:teuthology.orchestra.run.smithi149.stdout:(113/154): python3-jwt-2.4.0-1.el9.noarch.rpm 377 kB/s | 41 kB 00:00 2023-08-25T09:39:45.081 INFO:teuthology.orchestra.run.smithi149.stdout:(114/154): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2023-08-25T09:39:45.106 INFO:teuthology.orchestra.run.smithi149.stdout:(115/154): python3-logutils-0.3.5-21.el9.noarch 222 kB/s | 46 kB 00:00 2023-08-25T09:39:45.140 INFO:teuthology.orchestra.run.smithi121.stdout:(102/154): python3-cheroot-8.6.0-4.el9.noarch.r 557 kB/s | 172 kB 00:00 2023-08-25T09:39:45.140 INFO:teuthology.orchestra.run.smithi149.stdout:(116/154): python3-more-itertools-8.12.0-2.el9. 364 kB/s | 79 kB 00:00 2023-08-25T09:39:45.224 INFO:teuthology.orchestra.run.smithi149.stdout:(117/154): python3-natsort-7.1.1-5.el9.noarch.r 408 kB/s | 58 kB 00:00 2023-08-25T09:39:45.266 INFO:teuthology.orchestra.run.smithi149.stdout:(118/154): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2023-08-25T09:39:45.333 INFO:teuthology.orchestra.run.smithi149.stdout:(119/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 834 kB/s | 90 kB 00:00 2023-08-25T09:39:45.374 INFO:teuthology.orchestra.run.smithi149.stdout:(120/154): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2023-08-25T09:39:45.400 INFO:teuthology.orchestra.run.smithi149.stdout:(121/154): python3-pecan-1.4.2-3.el9.noarch.rpm 931 kB/s | 272 kB 00:00 2023-08-25T09:39:45.459 INFO:teuthology.orchestra.run.smithi149.stdout:(122/154): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2023-08-25T09:39:45.483 INFO:teuthology.orchestra.run.smithi149.stdout:(123/154): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2023-08-25T09:39:45.509 INFO:teuthology.orchestra.run.smithi149.stdout:(124/154): python3-tempora-5.0.0-2.el9.noarch.r 330 kB/s | 36 kB 00:00 2023-08-25T09:39:45.575 INFO:teuthology.orchestra.run.smithi149.stdout:(125/154): python3-typing-extensions-4.4.0-2.el 438 kB/s | 51 kB 00:00 2023-08-25T09:39:45.626 INFO:teuthology.orchestra.run.smithi149.stdout:(126/154): python3-websocket-client-1.2.3-2.el9 770 kB/s | 90 kB 00:00 2023-08-25T09:39:45.684 INFO:teuthology.orchestra.run.smithi149.stdout:(127/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2023-08-25T09:39:45.715 INFO:teuthology.orchestra.run.smithi121.stdout:(103/154): python3-cherrypy-18.6.1-2.el9.noarch 624 kB/s | 358 kB 00:00 2023-08-25T09:39:45.718 INFO:teuthology.orchestra.run.smithi149.stdout:(128/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.0 MB/s | 427 kB 00:00 2023-08-25T09:39:45.743 INFO:teuthology.orchestra.run.smithi149.stdout:(129/154): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-08-25T09:39:45.895 INFO:teuthology.orchestra.run.smithi149.stdout:(130/154): re2-20211101-2.el9.x86_64.rpm 924 kB/s | 192 kB 00:00 2023-08-25T09:39:45.969 INFO:teuthology.orchestra.run.smithi149.stdout:(131/154): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2023-08-25T09:39:46.023 INFO:teuthology.orchestra.run.smithi121.stdout:(104/154): python3-google-auth-2.22.0-1.el9.noa 638 kB/s | 197 kB 00:00 2023-08-25T09:39:46.078 INFO:teuthology.orchestra.run.smithi149.stdout:(132/154): NetworkManager-1.44.0-2.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-08-25T09:39:46.140 INFO:teuthology.orchestra.run.smithi121.stdout:(105/154): python3-jaraco-8.2.1-3.el9.noarch.rp 91 kB/s | 11 kB 00:00 2023-08-25T09:39:46.169 INFO:teuthology.orchestra.run.smithi149.stdout:(133/154): NetworkManager-libnm-1.44.0-2.el9.x8 20 MB/s | 1.8 MB 00:00 2023-08-25T09:39:46.203 INFO:teuthology.orchestra.run.smithi149.stdout:(134/154): NetworkManager-team-1.44.0-2.el9.x86 1.2 MB/s | 41 kB 00:00 2023-08-25T09:39:46.245 INFO:teuthology.orchestra.run.smithi149.stdout:(135/154): NetworkManager-tui-1.44.0-2.el9.x86_ 5.9 MB/s | 245 kB 00:00 2023-08-25T09:39:46.266 INFO:teuthology.orchestra.run.smithi121.stdout:(106/154): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2023-08-25T09:39:46.337 INFO:teuthology.orchestra.run.smithi149.stdout:(136/154): librados2-18.0.0-5703.gba6b39e4.el9. 5.5 MB/s | 3.3 MB 00:00 2023-08-25T09:39:46.362 INFO:teuthology.orchestra.run.smithi149.stdout:(137/154): elfutils-debuginfod-client-0.189-3.e 309 kB/s | 36 kB 00:00 2023-08-25T09:39:46.384 INFO:teuthology.orchestra.run.smithi121.stdout:(107/154): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2023-08-25T09:39:46.405 INFO:teuthology.orchestra.run.smithi149.stdout:(138/154): elfutils-libelf-0.189-3.el9.x86_64.r 2.9 MB/s | 192 kB 00:00 2023-08-25T09:39:46.438 INFO:teuthology.orchestra.run.smithi149.stdout:(139/154): elfutils-libs-0.189-3.el9.x86_64.rpm 3.4 MB/s | 254 kB 00:00 2023-08-25T09:39:46.500 INFO:teuthology.orchestra.run.smithi121.stdout:(108/154): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2023-08-25T09:39:46.513 INFO:teuthology.orchestra.run.smithi149.stdout:(140/154): iproute-6.2.0-5.el9.x86_64.rpm 7.3 MB/s | 785 kB 00:00 2023-08-25T09:39:46.555 INFO:teuthology.orchestra.run.smithi149.stdout:(141/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 4.0 MB/s | 448 kB 00:00 2023-08-25T09:39:46.581 INFO:teuthology.orchestra.run.smithi149.stdout:(142/154): libblkid-2.37.4-14.el9.x86_64.rpm 1.7 MB/s | 107 kB 00:00 2023-08-25T09:39:46.614 INFO:teuthology.orchestra.run.smithi149.stdout:(143/154): libfdisk-2.37.4-14.el9.x86_64.rpm 2.6 MB/s | 154 kB 00:00 2023-08-25T09:39:46.617 INFO:teuthology.orchestra.run.smithi121.stdout:(109/154): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2023-08-25T09:39:46.648 INFO:teuthology.orchestra.run.smithi149.stdout:(144/154): libmount-2.37.4-14.el9.x86_64.rpm 2.0 MB/s | 133 kB 00:00 2023-08-25T09:39:46.673 INFO:teuthology.orchestra.run.smithi149.stdout:(145/154): libsmartcols-2.37.4-14.el9.x86_64.rp 1.1 MB/s | 63 kB 00:00 2023-08-25T09:39:46.698 INFO:teuthology.orchestra.run.smithi149.stdout:(146/154): libuuid-2.37.4-14.el9.x86_64.rpm 573 kB/s | 28 kB 00:00 2023-08-25T09:39:46.734 INFO:teuthology.orchestra.run.smithi121.stdout:(110/154): python3-jwt+crypto-2.4.0-1.el9.noarc 78 kB/s | 9.0 kB 00:00 2023-08-25T09:39:46.765 INFO:teuthology.orchestra.run.smithi149.stdout:(147/154): openssl-3.0.7-24.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2023-08-25T09:39:46.851 INFO:teuthology.orchestra.run.smithi121.stdout:(111/154): python3-jwt-2.4.0-1.el9.noarch.rpm 351 kB/s | 41 kB 00:00 2023-08-25T09:39:46.859 INFO:teuthology.orchestra.run.smithi149.stdout:(148/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2023-08-25T09:39:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:(149/154): util-linux-2.37.4-14.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2023-08-25T09:39:47.024 INFO:teuthology.orchestra.run.smithi149.stdout:(150/154): util-linux-core-2.37.4-14.el9.x86_64 2.8 MB/s | 433 kB 00:00 2023-08-25T09:39:47.083 INFO:teuthology.orchestra.run.smithi149.stdout:(151/154): util-linux-user-2.37.4-14.el9.x86_64 218 kB/s | 30 kB 00:00 2023-08-25T09:39:47.142 INFO:teuthology.orchestra.run.smithi149.stdout:(152/154): xfsdump-3.1.12-3.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2023-08-25T09:39:47.200 INFO:teuthology.orchestra.run.smithi149.stdout:(153/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2023-08-25T09:39:47.231 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-08-25T09:39:47.292 INFO:teuthology.orchestra.run.smithi149.stdout:(154/154): librbd1-18.0.0-5703.gba6b39e4.el9.x8 2.2 MB/s | 3.0 MB 00:01 2023-08-25T09:39:47.303 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-08-25T09:39:47.303 INFO:teuthology.orchestra.run.smithi149.stdout:Total 14 MB/s | 206 MB 00:15 2023-08-25T09:39:47.399 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-08-25T09:39:47.405 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-25T09:39:47.456 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libuuid-2.37.4-14.el9.x86_64 2/177 2023-08-25T09:39:47.495 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libblkid-2.37.4-14.el9.x86_64 3/177 2023-08-25T09:39:47.502 INFO:teuthology.orchestra.run.smithi121.stdout:(112/154): ceph-test-18.0.0-5703.gba6b39e4.el9. 2.9 MB/s | 40 MB 00:14 2023-08-25T09:39:47.536 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libblkid-2.37.4-14.el9.x86_64 3/177 2023-08-25T09:39:47.576 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-25T09:39:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-25T09:39:47.678 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-25T09:39:47.717 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-08-25T09:39:47.717 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-08-25T09:39:47.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-25T09:39:47.767 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-25T09:39:47.817 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-25T09:39:47.910 INFO:teuthology.orchestra.run.smithi121.stdout:(113/154): libarrow-9.0.0-9.el9.x86_64.rpm 699 kB/s | 4.4 MB 00:06 2023-08-25T09:39:48.035 INFO:teuthology.orchestra.run.smithi121.stdout:(114/154): python3-more-itertools-8.12.0-2.el9. 633 kB/s | 79 kB 00:00 2023-08-25T09:39:48.140 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-25T09:39:48.152 INFO:teuthology.orchestra.run.smithi121.stdout:(115/154): python3-natsort-7.1.1-5.el9.noarch.r 495 kB/s | 58 kB 00:00 2023-08-25T09:39:48.177 INFO:teuthology.orchestra.run.smithi121.stdout:(116/154): python3-logutils-0.3.5-21.el9.noarch 68 kB/s | 46 kB 00:00 2023-08-25T09:39:48.234 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:39:48.294 INFO:teuthology.orchestra.run.smithi121.stdout:(117/154): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2023-08-25T09:39:48.368 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:39:48.411 INFO:teuthology.orchestra.run.smithi121.stdout:(118/154): python3-kubernetes-26.1.0-2.el9.noar 670 kB/s | 1.0 MB 00:01 2023-08-25T09:39:48.537 INFO:teuthology.orchestra.run.smithi121.stdout:(119/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 371 kB/s | 90 kB 00:00 2023-08-25T09:39:48.562 INFO:teuthology.orchestra.run.smithi121.stdout:(120/154): python3-repoze-lru-0.7-16.el9.noarch 205 kB/s | 31 kB 00:00 2023-08-25T09:39:48.610 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:39:48.702 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:39:48.712 INFO:teuthology.orchestra.run.smithi121.stdout:(121/154): python3-pecan-1.4.2-3.el9.noarch.rpm 486 kB/s | 272 kB 00:00 2023-08-25T09:39:48.738 INFO:teuthology.orchestra.run.smithi121.stdout:(122/154): python3-rsa-4.9-2.el9.noarch.rpm 337 kB/s | 59 kB 00:00 2023-08-25T09:39:48.739 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 13/177 2023-08-25T09:39:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:(123/154): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2023-08-25T09:39:48.855 INFO:teuthology.orchestra.run.smithi121.stdout:(124/154): python3-typing-extensions-4.4.0-2.el 435 kB/s | 51 kB 00:00 2023-08-25T09:39:48.896 INFO:teuthology.orchestra.run.smithi121.stdout:(125/154): python3-routes-2.5.1-5.el9.noarch.rp 524 kB/s | 188 kB 00:00 2023-08-25T09:39:48.905 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-25T09:39:48.962 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-25T09:39:48.998 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:39:49.082 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:39:49.104 INFO:teuthology.orchestra.run.smithi121.stdout:(126/154): python3-websocket-client-1.2.3-2.el9 359 kB/s | 90 kB 00:00 2023-08-25T09:39:49.116 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 17/177 2023-08-25T09:39:49.180 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 17/177 2023-08-25T09:39:49.237 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libmount-2.37.4-14.el9.x86_64 18/177 2023-08-25T09:39:49.264 INFO:teuthology.orchestra.run.smithi121.stdout:(127/154): python3-zc-lockfile-2.0-10.el9.noarc 125 kB/s | 20 kB 00:00 2023-08-25T09:39:49.306 INFO:teuthology.orchestra.run.smithi121.stdout:(128/154): python3-webob-1.8.7-6.el9.noarch.rpm 482 kB/s | 230 kB 00:00 2023-08-25T09:39:49.391 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libsmartcols-2.37.4-14.el9.x86_64 19/177 2023-08-25T09:39:49.521 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 20/177 2023-08-25T09:39:49.581 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 20/177 2023-08-25T09:39:49.648 INFO:teuthology.orchestra.run.smithi121.stdout:(129/154): re2-20211101-2.el9.x86_64.rpm 502 kB/s | 192 kB 00:00 2023-08-25T09:39:49.654 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:39:49.723 INFO:teuthology.orchestra.run.smithi121.stdout:(130/154): python3-werkzeug-2.0.3-3.el9.1.noarc 517 kB/s | 427 kB 00:00 2023-08-25T09:39:49.858 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:39:49.917 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-08-25T09:39:49.917 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-08-25T09:39:50.007 INFO:teuthology.orchestra.run.smithi121.stdout:(131/154): librbd1-18.0.0-5703.gba6b39e4.el9.x8 11 MB/s | 3.0 MB 00:00 2023-08-25T09:39:50.125 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:39:50.148 INFO:teuthology.orchestra.run.smithi121.stdout:(132/154): NetworkManager-1.44.0-2.el9.x86_64.r 16 MB/s | 2.2 MB 00:00 2023-08-25T09:39:50.170 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-25T09:39:50.205 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-25T09:39:50.249 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-25T09:39:50.257 INFO:teuthology.orchestra.run.smithi121.stdout:(133/154): NetworkManager-libnm-1.44.0-2.el9.x8 17 MB/s | 1.8 MB 00:00 2023-08-25T09:39:50.282 INFO:teuthology.orchestra.run.smithi121.stdout:(134/154): NetworkManager-team-1.44.0-2.el9.x86 1.6 MB/s | 41 kB 00:00 2023-08-25T09:39:50.320 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-25T09:39:50.365 INFO:teuthology.orchestra.run.smithi121.stdout:(135/154): NetworkManager-tui-1.44.0-2.el9.x86_ 2.9 MB/s | 245 kB 00:00 2023-08-25T09:39:50.386 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-25T09:39:50.411 INFO:teuthology.orchestra.run.smithi121.stdout:(136/154): elfutils-debuginfod-client-0.189-3.e 834 kB/s | 36 kB 00:00 2023-08-25T09:39:50.439 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-25T09:39:50.468 INFO:teuthology.orchestra.run.smithi121.stdout:(137/154): elfutils-libelf-0.189-3.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2023-08-25T09:39:50.477 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-25T09:39:50.523 INFO:teuthology.orchestra.run.smithi121.stdout:(138/154): elfutils-libs-0.189-3.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2023-08-25T09:39:50.552 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-25T09:39:50.585 INFO:teuthology.orchestra.run.smithi121.stdout:(139/154): iproute-6.2.0-5.el9.x86_64.rpm 11 MB/s | 785 kB 00:00 2023-08-25T09:39:50.600 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9. 30/177 2023-08-25T09:39:50.644 INFO:teuthology.orchestra.run.smithi121.stdout:(140/154): iproute-tc-6.2.0-5.el9.x86_64.rpm 7.5 MB/s | 448 kB 00:00 2023-08-25T09:39:50.648 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 31/177 2023-08-25T09:39:50.719 INFO:teuthology.orchestra.run.smithi121.stdout:(141/154): librados2-18.0.0-5703.gba6b39e4.el9. 3.1 MB/s | 3.3 MB 00:01 2023-08-25T09:39:50.729 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_6 32/177 2023-08-25T09:39:50.872 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-25T09:39:50.934 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-25T09:39:50.940 INFO:teuthology.orchestra.run.smithi121.stdout:(142/154): libblkid-2.37.4-14.el9.x86_64.rpm 363 kB/s | 107 kB 00:00 2023-08-25T09:39:51.027 INFO:teuthology.orchestra.run.smithi121.stdout:(143/154): libfdisk-2.37.4-14.el9.x86_64.rpm 499 kB/s | 154 kB 00:00 2023-08-25T09:39:51.061 INFO:teuthology.orchestra.run.smithi121.stdout:(144/154): libmount-2.37.4-14.el9.x86_64.rpm 1.1 MB/s | 133 kB 00:00 2023-08-25T09:39:51.087 INFO:teuthology.orchestra.run.smithi121.stdout:(145/154): libsmartcols-2.37.4-14.el9.x86_64.rp 1.1 MB/s | 63 kB 00:00 2023-08-25T09:39:51.111 INFO:teuthology.orchestra.run.smithi121.stdout:(146/154): libuuid-2.37.4-14.el9.x86_64.rpm 558 kB/s | 28 kB 00:00 2023-08-25T09:39:51.170 INFO:teuthology.orchestra.run.smithi121.stdout:(147/154): openssl-3.0.7-24.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2023-08-25T09:39:51.228 INFO:teuthology.orchestra.run.smithi121.stdout:(148/154): openssl-libs-3.0.7-24.el9.x86_64.rpm 19 MB/s | 2.1 MB 00:00 2023-08-25T09:39:51.304 INFO:teuthology.orchestra.run.smithi121.stdout:(149/154): util-linux-2.37.4-14.el9.x86_64.rpm 17 MB/s | 2.2 MB 00:00 2023-08-25T09:39:51.346 INFO:teuthology.orchestra.run.smithi121.stdout:(150/154): util-linux-core-2.37.4-14.el9.x86_64 3.7 MB/s | 433 kB 00:00 2023-08-25T09:39:51.397 INFO:teuthology.orchestra.run.smithi121.stdout:(151/154): util-linux-user-2.37.4-14.el9.x86_64 324 kB/s | 30 kB 00:00 2023-08-25T09:39:51.438 INFO:teuthology.orchestra.run.smithi121.stdout:(152/154): xfsdump-3.1.12-3.el9.x86_64.rpm 3.4 MB/s | 321 kB 00:00 2023-08-25T09:39:51.458 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-25T09:39:51.480 INFO:teuthology.orchestra.run.smithi121.stdout:(153/154): xfsprogs-5.19.0-4.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2023-08-25T09:39:51.545 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-25T09:39:51.624 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-25T09:39:51.959 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : util-linux-core-2.37.4-14.el9.x86_64 38/177 2023-08-25T09:39:51.978 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: util-linux-core-2.37.4-14.el9.x86_64 38/177 2023-08-25T09:39:52.005 INFO:teuthology.orchestra.run.smithi121.stdout:(154/154): thrift-0.15.0-2.el9.x86_64.rpm 600 kB/s | 1.6 MB 00:02 2023-08-25T09:39:52.013 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-08-25T09:39:52.013 INFO:teuthology.orchestra.run.smithi121.stdout:Total 9.3 MB/s | 206 MB 00:22 2023-08-25T09:39:52.018 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_6 39/177 2023-08-25T09:39:52.046 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-08-25T09:39:52.058 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-25T09:39:52.166 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-25T09:39:52.267 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-08-25T09:39:52.267 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-08-25T09:39:52.477 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-25T09:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libfdisk-2.37.4-14.el9.x86_64 43/177 2023-08-25T09:39:53.808 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-08-25T09:39:53.808 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-08-25T09:39:53.886 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : util-linux-2.37.4-14.el9.x86_64 44/177 2023-08-25T09:39:54.591 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-25T09:39:54.653 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-14.el9.x86_64 46/177 2023-08-25T09:39:54.798 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-25T09:39:55.093 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-25T09:39:55.212 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-25T09:39:55.264 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-25T09:39:55.327 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-25T09:39:55.408 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-25T09:39:55.448 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-25T09:39:55.501 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-25T09:39:55.555 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-25T09:39:55.614 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-25T09:39:55.677 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-25T09:39:55.816 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-25T09:39:55.862 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-25T09:39:55.911 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-25T09:39:56.021 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-25T09:39:56.069 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-25T09:39:56.118 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-25T09:39:56.152 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-25T09:39:56.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-25T09:39:56.221 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-25T09:39:56.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-25T09:39:56.381 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-25T09:39:56.438 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-25T09:39:56.501 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-25T09:39:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-08-25T09:39:56.682 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-25T09:39:56.693 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-25T09:39:56.759 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libuuid-2.37.4-14.el9.x86_64 2/177 2023-08-25T09:39:56.760 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-25T09:39:56.836 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libblkid-2.37.4-14.el9.x86_64 3/177 2023-08-25T09:39:56.914 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-25T09:39:56.956 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libblkid-2.37.4-14.el9.x86_64 3/177 2023-08-25T09:39:56.980 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-25T09:39:57.017 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-25T09:39:57.030 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-25T09:39:57.059 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-25T09:39:57.100 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-25T09:39:57.111 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-25T09:39:57.150 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-25T09:39:57.192 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-25T09:39:57.193 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-25T09:39:57.238 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-25T09:39:57.246 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-25T09:39:57.276 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-25T09:39:57.285 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-25T09:39:57.360 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-25T09:39:57.391 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-25T09:39:57.403 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-25T09:39:57.445 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-25T09:39:57.494 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-25T09:39:57.537 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-25T09:39:57.643 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-25T09:39:57.690 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-25T09:39:57.802 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-25T09:39:57.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-25T09:39:57.857 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-25T09:39:57.892 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:39:58.045 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:39:58.084 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:39:58.219 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:39:58.267 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 13/177 2023-08-25T09:39:58.514 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-25T09:39:58.589 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-25T09:39:58.591 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-25T09:39:58.622 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:39:58.646 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-25T09:39:58.689 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-25T09:39:58.738 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-25T09:39:58.798 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:39:58.832 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 17/177 2023-08-25T09:39:58.924 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-25T09:39:58.931 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 17/177 2023-08-25T09:39:58.961 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-25T09:39:58.994 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libmount-2.37.4-14.el9.x86_64 18/177 2023-08-25T09:39:59.046 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-25T09:39:59.348 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libsmartcols-2.37.4-14.el9.x86_64 19/177 2023-08-25T09:39:59.511 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 20/177 2023-08-25T09:39:59.599 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 20/177 2023-08-25T09:39:59.689 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-25T09:39:59.808 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-25T09:39:59.833 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:39:59.898 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:40:00.367 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:40:00.411 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-25T09:40:00.423 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-08-25T09:40:00.448 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-25T09:40:00.516 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-25T09:40:00.571 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-25T09:40:00.583 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.0.7-24.el9.x86_64 1/177 2023-08-25T09:40:00.642 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libuuid-2.37.4-14.el9.x86_64 2/177 2023-08-25T09:40:00.715 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libblkid-2.37.4-14.el9.x86_64 3/177 2023-08-25T09:40:00.724 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-25T09:40:00.749 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libblkid-2.37.4-14.el9.x86_64 3/177 2023-08-25T09:40:00.774 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-25T09:40:00.801 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/177 2023-08-25T09:40:00.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-25T09:40:00.861 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libelf-0.189-3.el9.x86_64 5/177 2023-08-25T09:40:00.915 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/177 2023-08-25T09:40:00.922 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-25T09:40:00.969 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/177 2023-08-25T09:40:00.972 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9. 30/177 2023-08-25T09:40:01.013 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/177 2023-08-25T09:40:01.022 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-25T09:40:01.032 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 31/177 2023-08-25T09:40:01.088 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/177 2023-08-25T09:40:01.112 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-25T09:40:01.151 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-25T09:40:01.156 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_6 32/177 2023-08-25T09:40:01.190 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-25T09:40:01.226 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-25T09:40:01.354 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-25T09:40:01.422 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-25T09:40:01.449 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/177 2023-08-25T09:40:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-25T09:40:01.581 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 106/177 2023-08-25T09:40:01.611 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:40:01.696 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 106/177 2023-08-25T09:40:01.728 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:40:01.737 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 107/177 2023-08-25T09:40:01.781 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-25T09:40:01.781 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:40:01.872 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:40:01.918 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 13/177 2023-08-25T09:40:02.091 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/177 2023-08-25T09:40:02.149 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-25T09:40:02.165 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/177 2023-08-25T09:40:02.210 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:40:02.211 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-25T09:40:02.251 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 110/177 2023-08-25T09:40:02.254 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-25T09:40:02.312 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:40:02.321 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 110/177 2023-08-25T09:40:02.353 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 111/177 2023-08-25T09:40:02.353 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 17/177 2023-08-25T09:40:02.379 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-25T09:40:02.423 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 17/177 2023-08-25T09:40:02.471 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : util-linux-core-2.37.4-14.el9.x86_64 38/177 2023-08-25T09:40:02.490 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libmount-2.37.4-14.el9.x86_64 18/177 2023-08-25T09:40:02.514 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: util-linux-core-2.37.4-14.el9.x86_64 38/177 2023-08-25T09:40:02.589 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_6 39/177 2023-08-25T09:40:02.641 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-25T09:40:02.645 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libsmartcols-2.37.4-14.el9.x86_64 19/177 2023-08-25T09:40:02.812 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-25T09:40:02.875 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-25T09:40:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 20/177 2023-08-25T09:40:02.935 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 20/177 2023-08-25T09:40:03.010 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:40:03.111 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:40:03.249 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libfdisk-2.37.4-14.el9.x86_64 43/177 2023-08-25T09:40:03.398 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 21/177 2023-08-25T09:40:03.440 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : util-linux-2.37.4-14.el9.x86_64 44/177 2023-08-25T09:40:03.488 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/177 2023-08-25T09:40:03.525 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-25T09:40:03.533 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/177 2023-08-25T09:40:03.585 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 24/177 2023-08-25T09:40:03.591 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-14.el9.x86_64 46/177 2023-08-25T09:40:03.642 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 25/177 2023-08-25T09:40:03.732 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/177 2023-08-25T09:40:03.791 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/177 2023-08-25T09:40:03.797 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-25T09:40:03.836 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/177 2023-08-25T09:40:03.894 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-25T09:40:03.921 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/177 2023-08-25T09:40:03.974 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9. 30/177 2023-08-25T09:40:04.034 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 31/177 2023-08-25T09:40:04.052 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-25T09:40:04.097 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-25T09:40:04.132 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_6 32/177 2023-08-25T09:40:04.168 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-25T09:40:04.266 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-25T09:40:04.283 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/177 2023-08-25T09:40:04.331 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-25T09:40:04.369 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/177 2023-08-25T09:40:04.404 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-25T09:40:04.444 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:04.482 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:04.505 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-25T09:40:04.573 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-25T09:40:04.633 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-25T09:40:04.822 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-25T09:40:04.871 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-25T09:40:04.901 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/177 2023-08-25T09:40:04.915 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-25T09:40:04.988 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/177 2023-08-25T09:40:05.015 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:05.053 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-25T09:40:05.061 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 113/177 2023-08-25T09:40:05.084 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/177 2023-08-25T09:40:05.119 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-25T09:40:05.149 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 113/177 2023-08-25T09:40:05.149 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-25T09:40:05.149 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-25T09:40:05.149 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:05.175 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-25T09:40:05.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 114/177 2023-08-25T09:40:05.219 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-25T09:40:05.259 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-25T09:40:05.302 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-25T09:40:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-25T09:40:05.527 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-core-2.37.4-14.el9.x86_64 38/177 2023-08-25T09:40:05.542 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-25T09:40:05.546 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: util-linux-core-2.37.4-14.el9.x86_64 38/177 2023-08-25T09:40:05.613 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_6 39/177 2023-08-25T09:40:05.621 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-25T09:40:05.661 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/177 2023-08-25T09:40:05.711 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-25T09:40:05.780 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libs-0.189-3.el9.x86_64 41/177 2023-08-25T09:40:06.013 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-25T09:40:06.079 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-25T09:40:06.214 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : iproute-6.2.0-5.el9.x86_64 42/177 2023-08-25T09:40:06.261 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-25T09:40:06.324 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-25T09:40:06.348 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-25T09:40:06.412 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-25T09:40:06.466 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-25T09:40:06.472 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : libfdisk-2.37.4-14.el9.x86_64 43/177 2023-08-25T09:40:06.525 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-25T09:40:06.589 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-25T09:40:06.661 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-25T09:40:06.719 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-25T09:40:06.859 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-25T09:40:06.905 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-25T09:40:06.956 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-25T09:40:06.997 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-2.37.4-14.el9.x86_64 44/177 2023-08-25T09:40:07.020 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-25T09:40:07.077 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-25T09:40:07.232 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-25T09:40:07.282 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-25T09:40:07.385 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : xfsprogs-5.19.0-4.el9.x86_64 45/177 2023-08-25T09:40:07.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-25T09:40:07.448 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-14.el9.x86_64 46/177 2023-08-25T09:40:07.504 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-25T09:40:07.595 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/177 2023-08-25T09:40:08.031 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.0.7-24.el9.x86_64 48/177 2023-08-25T09:40:08.160 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-2.el9.x86_64 49/177 2023-08-25T09:40:08.208 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 50/177 2023-08-25T09:40:08.280 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/177 2023-08-25T09:40:08.370 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/177 2023-08-25T09:40:08.417 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/177 2023-08-25T09:40:08.491 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-25T09:40:08.495 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/177 2023-08-25T09:40:08.553 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-25T09:40:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/177 2023-08-25T09:40:08.595 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-25T09:40:08.621 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/177 2023-08-25T09:40:08.637 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-25T09:40:08.680 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/177 2023-08-25T09:40:08.827 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/177 2023-08-25T09:40:08.912 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-25T09:40:08.914 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/177 2023-08-25T09:40:08.967 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-25T09:40:08.980 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/177 2023-08-25T09:40:09.088 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/177 2023-08-25T09:40:09.094 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-25T09:40:09.139 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.22.0-1.el9.noarch 62/177 2023-08-25T09:40:09.195 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/177 2023-08-25T09:40:09.238 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/177 2023-08-25T09:40:09.298 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 65/177 2023-08-25T09:40:09.340 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fmt-8.1.1-5.el9.x86_64 66/177 2023-08-25T09:40:09.448 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-36.el9.x86_64 67/177 2023-08-25T09:40:09.508 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.16-1.el9.x86_64 68/177 2023-08-25T09:40:09.573 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 69/177 2023-08-25T09:40:09.646 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 70/177 2023-08-25T09:40:09.868 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 71/177 2023-08-25T09:40:09.905 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-25T09:40:09.937 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 72/177 2023-08-25T09:40:10.045 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-25T09:40:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 73/177 2023-08-25T09:40:10.165 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 74/177 2023-08-25T09:40:10.211 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 75/177 2023-08-25T09:40:10.261 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 76/177 2023-08-25T09:40:10.309 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 77/177 2023-08-25T09:40:10.360 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-15.el9.x86_64 78/177 2023-08-25T09:40:10.411 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/177 2023-08-25T09:40:10.472 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/177 2023-08-25T09:40:10.519 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/177 2023-08-25T09:40:10.638 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/177 2023-08-25T09:40:10.688 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/177 2023-08-25T09:40:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/177 2023-08-25T09:40:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/177 2023-08-25T09:40:10.856 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/177 2023-08-25T09:40:10.961 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/177 2023-08-25T09:40:11.033 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/177 2023-08-25T09:40:11.150 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/177 2023-08-25T09:40:11.217 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/177 2023-08-25T09:40:11.611 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-25T09:40:11.712 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-25T09:40:11.758 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-25T09:40:11.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-25T09:40:11.829 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-25T09:40:11.951 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/177 2023-08-25T09:40:12.023 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/177 2023-08-25T09:40:12.074 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/177 2023-08-25T09:40:12.123 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/177 2023-08-25T09:40:12.196 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-25T09:40:12.228 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 106/177 2023-08-25T09:40:12.317 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/177 2023-08-25T09:40:12.332 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 106/177 2023-08-25T09:40:12.362 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/177 2023-08-25T09:40:12.366 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 107/177 2023-08-25T09:40:12.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-25T09:40:12.456 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/177 2023-08-25T09:40:12.920 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-25T09:40:13.103 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/177 2023-08-25T09:40:13.130 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 110/177 2023-08-25T09:40:13.224 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 110/177 2023-08-25T09:40:13.225 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/177 2023-08-25T09:40:13.257 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 111/177 2023-08-25T09:40:14.448 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/177 2023-08-25T09:40:14.562 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/177 2023-08-25T09:40:14.610 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 102/177 2023-08-25T09:40:14.658 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : jq-1.6-15.el9.x86_64 103/177 2023-08-25T09:40:14.702 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/177 2023-08-25T09:40:15.051 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/177 2023-08-25T09:40:15.099 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 106/177 2023-08-25T09:40:15.188 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 106/177 2023-08-25T09:40:15.236 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 107/177 2023-08-25T09:40:15.290 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/177 2023-08-25T09:40:15.723 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 109/177 2023-08-25T09:40:15.776 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 110/177 2023-08-25T09:40:15.799 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 110/177 2023-08-25T09:40:15.845 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 111/177 2023-08-25T09:40:16.481 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:16.531 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 113/177 2023-08-25T09:40:16.760 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 113/177 2023-08-25T09:40:16.760 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-25T09:40:16.761 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-25T09:40:16.761 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:16.808 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 114/177 2023-08-25T09:40:18.004 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:18.049 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:18.576 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 112/177 2023-08-25T09:40:18.627 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 113/177 2023-08-25T09:40:18.695 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 113/177 2023-08-25T09:40:18.695 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-08-25T09:40:18.695 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-08-25T09:40:18.695 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:18.762 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 114/177 2023-08-25T09:40:18.917 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 114/177 2023-08-25T09:40:18.917 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-08-25T09:40:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-08-25T09:40:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-08-25T09:40:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-08-25T09:40:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-08-25T09:40:18.918 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2023-08-25T09:40:18.919 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-08-25T09:40:18.919 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:19.083 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 115/177 2023-08-25T09:40:19.099 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 115/177 2023-08-25T09:40:19.099 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:19.099 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-25T09:40:19.100 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:20.626 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 116/177 2023-08-25T09:40:20.652 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 116/177 2023-08-25T09:40:20.652 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:20.652 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-25T09:40:20.652 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-25T09:40:20.653 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-25T09:40:20.653 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:20.868 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 117/177 2023-08-25T09:40:20.891 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 117/177 2023-08-25T09:40:20.893 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:20.893 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-25T09:40:20.894 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-25T09:40:20.894 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-25T09:40:20.894 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:21.335 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 118/177 2023-08-25T09:40:21.358 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 118/177 2023-08-25T09:40:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-25T09:40:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-25T09:40:21.359 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-25T09:40:21.360 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:21.454 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-25T09:40:21.883 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 120/177 2023-08-25T09:40:21.919 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 120/177 2023-08-25T09:40:21.955 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 121/177 2023-08-25T09:40:22.026 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 122/177 2023-08-25T09:40:22.067 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 123/177 2023-08-25T09:40:22.288 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 123/177 2023-08-25T09:40:22.326 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 124/177 2023-08-25T09:40:23.294 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 124/177 2023-08-25T09:40:23.335 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 125/177 2023-08-25T09:40:23.434 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 125/177 2023-08-25T09:40:23.601 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 126/177 2023-08-25T09:40:23.655 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 127/177 2023-08-25T09:40:23.678 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 127/177 2023-08-25T09:40:23.678 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:23.678 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-25T09:40:23.678 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-25T09:40:23.679 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-25T09:40:23.679 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:23.729 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 128/177 2023-08-25T09:40:23.741 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 128/177 2023-08-25T09:40:23.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 129/177 2023-08-25T09:40:24.552 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-25T09:40:24.598 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 131/177 2023-08-25T09:40:24.622 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 131/177 2023-08-25T09:40:24.622 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:24.622 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-25T09:40:24.622 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-25T09:40:24.623 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-25T09:40:24.623 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:24.674 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 132/177 2023-08-25T09:40:24.696 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 132/177 2023-08-25T09:40:24.697 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:24.697 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-25T09:40:24.697 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:24.749 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 133/177 2023-08-25T09:40:24.772 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 133/177 2023-08-25T09:40:24.773 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:24.773 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-25T09:40:24.773 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-25T09:40:24.773 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-25T09:40:24.774 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:25.083 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:25.106 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:25.107 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:25.107 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-25T09:40:25.107 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-25T09:40:25.107 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-25T09:40:25.107 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:28.918 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 135/177 2023-08-25T09:40:28.967 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 136/177 2023-08-25T09:40:29.006 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 137/177 2023-08-25T09:40:29.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-25T09:40:29.337 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-25T09:40:29.352 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 114/177 2023-08-25T09:40:29.353 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2023-08-25T09:40:29.353 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2023-08-25T09:40:29.353 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2023-08-25T09:40:29.354 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2023-08-25T09:40:29.354 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2023-08-25T09:40:29.354 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2023-08-25T09:40:29.354 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2023-08-25T09:40:29.355 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:29.387 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 140/177 2023-08-25T09:40:29.435 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-25T09:40:29.580 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-25T09:40:29.585 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 115/177 2023-08-25T09:40:29.655 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 115/177 2023-08-25T09:40:29.656 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:29.656 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-25T09:40:29.656 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:29.710 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : util-linux-user-2.37.4-14.el9.x86_64 143/177 2023-08-25T09:40:30.118 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-25T09:40:30.228 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-25T09:40:30.266 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_ 146/177 2023-08-25T09:40:30.304 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/177 2023-08-25T09:40:30.375 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/177 2023-08-25T09:40:31.011 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:31.057 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:31.077 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:31.352 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 116/177 2023-08-25T09:40:31.459 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 116/177 2023-08-25T09:40:31.459 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:31.459 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-25T09:40:31.459 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-25T09:40:31.460 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-25T09:40:31.460 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:31.702 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 117/177 2023-08-25T09:40:31.776 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 117/177 2023-08-25T09:40:31.788 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:31.789 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-25T09:40:31.789 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-25T09:40:31.789 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-25T09:40:31.789 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:31.902 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 150/177 2023-08-25T09:40:31.970 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-25T09:40:31.991 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 114/177 2023-08-25T09:40:31.992 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2023-08-25T09:40:31.992 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2023-08-25T09:40:31.993 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2023-08-25T09:40:31.993 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2023-08-25T09:40:31.993 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2023-08-25T09:40:31.993 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2023-08-25T09:40:31.993 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2023-08-25T09:40:31.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:32.018 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-25T09:40:32.108 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-25T09:40:32.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-25T09:40:32.175 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 115/177 2023-08-25T09:40:32.190 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 115/177 2023-08-25T09:40:32.191 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:32.191 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-08-25T09:40:32.191 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:32.193 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-25T09:40:32.224 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-25T09:40:32.259 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-25T09:40:32.259 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-25T09:40:32.278 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 118/177 2023-08-25T09:40:32.346 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-25T09:40:32.355 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 118/177 2023-08-25T09:40:32.355 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:32.355 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-25T09:40:32.355 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-25T09:40:32.355 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-25T09:40:32.356 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-25T09:40:32.385 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-25T09:40:32.479 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-25T09:40:32.480 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-25T09:40:32.513 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-25T09:40:32.555 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-25T09:40:32.589 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-25T09:40:32.630 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-25T09:40:32.671 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-25T09:40:32.728 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-25T09:40:32.776 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-25T09:40:32.810 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-25T09:40:32.852 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-25T09:40:32.961 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-25T09:40:33.093 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 120/177 2023-08-25T09:40:33.131 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 120/177 2023-08-25T09:40:33.145 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-25T09:40:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:33.152 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:33.177 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 121/177 2023-08-25T09:40:33.290 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 122/177 2023-08-25T09:40:33.335 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 123/177 2023-08-25T09:40:33.663 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 123/177 2023-08-25T09:40:33.701 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 116/177 2023-08-25T09:40:33.710 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 124/177 2023-08-25T09:40:33.726 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 116/177 2023-08-25T09:40:33.727 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:33.727 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-08-25T09:40:33.727 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-25T09:40:33.727 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-08-25T09:40:33.727 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-25T09:40:33.863 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-25T09:40:33.897 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-25T09:40:33.930 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-25T09:40:33.951 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 117/177 2023-08-25T09:40:33.964 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-25T09:40:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 117/177 2023-08-25T09:40:33.974 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:33.974 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-08-25T09:40:33.974 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-25T09:40:33.974 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-08-25T09:40:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:34.036 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-25T09:40:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 118/177 2023-08-25T09:40:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 118/177 2023-08-25T09:40:34.442 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:34.442 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-08-25T09:40:34.442 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-25T09:40:34.442 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-08-25T09:40:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:34.563 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 119/177 2023-08-25T09:40:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 124/177 2023-08-25T09:40:34.902 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 125/177 2023-08-25T09:40:34.932 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 120/177 2023-08-25T09:40:34.977 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 120/177 2023-08-25T09:40:35.022 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 121/177 2023-08-25T09:40:35.045 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 125/177 2023-08-25T09:40:35.101 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 122/177 2023-08-25T09:40:35.168 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 123/177 2023-08-25T09:40:35.227 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 126/177 2023-08-25T09:40:35.255 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 127/177 2023-08-25T09:40:35.337 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 127/177 2023-08-25T09:40:35.338 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:35.338 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-25T09:40:35.338 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-25T09:40:35.338 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-25T09:40:35.338 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:35.385 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 123/177 2023-08-25T09:40:35.388 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 128/177 2023-08-25T09:40:35.426 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 128/177 2023-08-25T09:40:35.435 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 124/177 2023-08-25T09:40:35.491 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 129/177 2023-08-25T09:40:36.340 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-25T09:40:36.382 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 131/177 2023-08-25T09:40:36.391 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 124/177 2023-08-25T09:40:36.443 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 125/177 2023-08-25T09:40:36.466 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 131/177 2023-08-25T09:40:36.467 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:36.467 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-25T09:40:36.467 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-25T09:40:36.468 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-25T09:40:36.468 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:36.533 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 132/177 2023-08-25T09:40:36.540 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 125/177 2023-08-25T09:40:36.631 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 132/177 2023-08-25T09:40:36.631 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:36.631 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-25T09:40:36.631 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:36.708 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 133/177 2023-08-25T09:40:36.715 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 126/177 2023-08-25T09:40:36.771 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 127/177 2023-08-25T09:40:36.793 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 127/177 2023-08-25T09:40:36.793 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:36.794 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-08-25T09:40:36.794 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-25T09:40:36.794 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-08-25T09:40:36.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:36.821 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 133/177 2023-08-25T09:40:36.821 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:36.821 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-25T09:40:36.821 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-25T09:40:36.822 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-25T09:40:36.822 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:36.888 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 128/177 2023-08-25T09:40:36.898 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 128/177 2023-08-25T09:40:36.959 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 129/177 2023-08-25T09:40:37.204 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:37.288 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:37.288 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:37.289 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-25T09:40:37.289 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-25T09:40:37.289 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-25T09:40:37.289 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:37.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/177 2023-08-25T09:40:37.765 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 131/177 2023-08-25T09:40:37.788 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 131/177 2023-08-25T09:40:37.788 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:37.788 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-08-25T09:40:37.788 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-25T09:40:37.789 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-08-25T09:40:37.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:37.849 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 132/177 2023-08-25T09:40:37.871 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 132/177 2023-08-25T09:40:37.871 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:37.872 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-08-25T09:40:37.872 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:37.933 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 133/177 2023-08-25T09:40:37.956 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 133/177 2023-08-25T09:40:37.957 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:37.957 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-08-25T09:40:37.957 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-25T09:40:37.957 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-08-25T09:40:37.957 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:38.277 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:38.302 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:38.303 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-08-25T09:40:38.303 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-08-25T09:40:38.304 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-25T09:40:38.304 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-08-25T09:40:38.304 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:39.607 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 1/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 2/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 3/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 4/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 6/177 2023-08-25T09:40:39.608 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 7/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 8/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 9/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 10/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 13/177 2023-08-25T09:40:39.609 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_ 14/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 15/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_6 17/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 18/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 19/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9. 21/177 2023-08-25T09:40:39.610 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_6 22/177 2023-08-25T09:40:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 23/177 2023-08-25T09:40:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 24/177 2023-08-25T09:40:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 25/177 2023-08-25T09:40:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 26/177 2023-08-25T09:40:39.611 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 27/177 2023-08-25T09:40:39.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 28/177 2023-08-25T09:40:39.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/177 2023-08-25T09:40:39.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 30/177 2023-08-25T09:40:39.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 31/177 2023-08-25T09:40:39.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/177 2023-08-25T09:40:39.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/177 2023-08-25T09:40:39.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 34/177 2023-08-25T09:40:39.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/177 2023-08-25T09:40:39.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 36/177 2023-08-25T09:40:39.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 37/177 2023-08-25T09:40:39.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 38/177 2023-08-25T09:40:39.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-25T09:40:39.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-25T09:40:39.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-25T09:40:39.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-25T09:40:39.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-25T09:40:39.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-25T09:40:39.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-14.el9.x86_64 53/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-25T09:40:39.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-25T09:40:39.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-25T09:40:39.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-25T09:40:39.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 85/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 86/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/177 2023-08-25T09:40:39.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 91/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-25T09:40:39.630 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-25T09:40:39.631 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-25T09:40:39.632 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-25T09:40:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-25T09:40:39.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 132/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-25T09:40:39.635 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 136/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 138/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 140/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 142/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-25T09:40:39.636 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-25T09:40:39.637 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libblkid-2.37.4-14.el9.x86_64 154/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libfdisk-2.37.4-14.el9.x86_64 156/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libmount-2.37.4-14.el9.x86_64 158/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-25T09:40:39.638 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsmartcols-2.37.4-14.el9.x86_64 160/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-2.37.4-14.el9.x86_64 162/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-25T09:40:39.639 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-2.37.4-14.el9.x86_64 168/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-core-2.37.4-14.el9.x86_64 170/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-user-2.37.4-14.el9.x86_64 172/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-25T09:40:39.640 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-25T09:40:39.641 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-25T09:40:41.464 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 135/177 2023-08-25T09:40:41.519 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 136/177 2023-08-25T09:40:41.553 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 137/177 2023-08-25T09:40:41.834 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-25T09:40:41.963 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-25T09:40:42.021 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 140/177 2023-08-25T09:40:42.070 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 135/177 2023-08-25T09:40:42.088 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-25T09:40:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 136/177 2023-08-25T09:40:42.154 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-25T09:40:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 137/177 2023-08-25T09:40:42.281 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : util-linux-user-2.37.4-14.el9.x86_64 143/177 2023-08-25T09:40:42.322 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-25T09:40:42.363 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 138/177 2023-08-25T09:40:42.391 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-25T09:40:42.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_ 146/177 2023-08-25T09:40:42.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-25T09:40:42.450 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:42.450 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-08-25T09:40:42.450 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:42.451 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:42.451 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:42.451 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:42.451 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-25T09:40:42.452 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-25T09:40:42.452 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-25T09:40:42.452 INFO:teuthology.orchestra.run.smithi089.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-25T09:40:42.453 INFO:teuthology.orchestra.run.smithi089.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-25T09:40:42.453 INFO:teuthology.orchestra.run.smithi089.stdout: libblkid-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.453 INFO:teuthology.orchestra.run.smithi089.stdout: libfdisk-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.454 INFO:teuthology.orchestra.run.smithi089.stdout: libmount-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.454 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.454 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.454 INFO:teuthology.orchestra.run.smithi089.stdout: libsmartcols-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.455 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.455 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:42.455 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:42.455 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.456 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-core-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.456 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-user-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.456 INFO:teuthology.orchestra.run.smithi089.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-25T09:40:42.456 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-25T09:40:42.457 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-08-25T09:40:42.457 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2023-08-25T09:40:42.457 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2023-08-25T09:40:42.458 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-25T09:40:42.458 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.458 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.458 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.459 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.459 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.460 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.460 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.460 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.460 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.461 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.461 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.461 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.461 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.462 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.462 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.462 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.463 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.463 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.463 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.463 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.464 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.464 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.464 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:42.465 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-25T09:40:42.465 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2023-08-25T09:40:42.465 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-25T09:40:42.465 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-25T09:40:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-25T09:40:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-25T09:40:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-25T09:40:42.466 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-25T09:40:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-15.el9.x86_64 2023-08-25T09:40:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-25T09:40:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-25T09:40:42.467 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-25T09:40:42.468 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.468 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.468 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.469 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-25T09:40:42.469 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-25T09:40:42.469 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-25T09:40:42.469 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-25T09:40:42.470 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-25T09:40:42.470 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.470 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.470 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-25T09:40:42.471 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.471 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-25T09:40:42.471 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-25T09:40:42.471 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-14.el9.x86_64 2023-08-25T09:40:42.472 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-25T09:40:42.472 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-25T09:40:42.472 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-25T09:40:42.472 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-25T09:40:42.473 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-25T09:40:42.473 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:42.473 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-25T09:40:42.473 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-13.11-1.el9.x86_64 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-25T09:40:42.474 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-25T09:40:42.475 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-25T09:40:42.476 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-25T09:40:42.477 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-25T09:40:42.478 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-25T09:40:42.479 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-25T09:40:42.480 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-25T09:40:42.481 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-2.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-25T09:40:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-25T09:40:42.483 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/177 2023-08-25T09:40:42.483 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-25T09:40:42.483 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:40:42.484 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-08-25T09:40:42.489 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 139/177 2023-08-25T09:40:42.537 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/177 2023-08-25T09:40:42.557 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 140/177 2023-08-25T09:40:42.613 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 141/177 2023-08-25T09:40:42.733 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : xfsdump-3.1.12-3.el9.x86_64 142/177 2023-08-25T09:40:42.822 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : util-linux-user-2.37.4-14.el9.x86_64 143/177 2023-08-25T09:40:43.016 DEBUG:teuthology.parallel:result is None 2023-08-25T09:40:43.212 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : iproute-tc-6.2.0-5.el9.x86_64 144/177 2023-08-25T09:40:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/177 2023-08-25T09:40:43.352 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_ 146/177 2023-08-25T09:40:43.407 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/177 2023-08-25T09:40:43.470 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/177 2023-08-25T09:40:43.475 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:43.527 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:43.589 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:44.099 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:44.151 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:44.172 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/177 2023-08-25T09:40:44.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 150/177 2023-08-25T09:40:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 150/177 2023-08-25T09:40:45.053 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-25T09:40:45.072 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 151/177 2023-08-25T09:40:45.112 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-25T09:40:45.128 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/177 2023-08-25T09:40:45.233 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-25T09:40:45.258 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/177 2023-08-25T09:40:45.306 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-25T09:40:45.308 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/177 2023-08-25T09:40:45.354 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-25T09:40:45.360 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.41.8-1.el9.x86_64 155/177 2023-08-25T09:40:45.391 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-25T09:40:45.408 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-debuginfod-client-0.188-3.el9.x86_64 156/177 2023-08-25T09:40:45.434 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-25T09:40:45.435 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-25T09:40:45.452 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libs-0.188-3.el9.x86_64 157/177 2023-08-25T09:40:45.452 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-25T09:40:45.564 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-25T09:40:45.611 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-25T09:40:45.611 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-25T09:40:45.612 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/177 2023-08-25T09:40:45.661 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.0.7-2.el9.x86_64 159/177 2023-08-25T09:40:45.661 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-25T09:40:45.754 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-25T09:40:45.797 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-25T09:40:45.808 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/177 2023-08-25T09:40:45.856 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-25T09:40:45.862 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : xfsdump-3.1.10-1.el9.x86_64 161/177 2023-08-25T09:40:45.899 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-25T09:40:45.917 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : xfsprogs-5.14.2-1.el9.x86_64 162/177 2023-08-25T09:40:45.948 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-25T09:40:45.971 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : iproute-tc-6.0.0-2.el9.x86_64 163/177 2023-08-25T09:40:45.998 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-25T09:40:46.023 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : iproute-6.0.0-2.el9.x86_64 164/177 2023-08-25T09:40:46.063 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-25T09:40:46.092 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : util-linux-user-2.37.4-9.el9.x86_64 165/177 2023-08-25T09:40:46.144 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-25T09:40:46.177 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : util-linux-2.37.4-9.el9.x86_64 166/177 2023-08-25T09:40:46.185 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-25T09:40:46.227 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : util-linux-core-2.37.4-9.el9.x86_64 167/177 2023-08-25T09:40:46.228 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-25T09:40:46.260 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libfdisk-2.37.4-9.el9.x86_64 168/177 2023-08-25T09:40:46.270 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-25T09:40:46.295 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libmount-2.37.4-9.el9.x86_64 169/177 2023-08-25T09:40:46.312 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-25T09:40:46.319 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:46.319 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:46.328 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libblkid-2.37.4-9.el9.x86_64 170/177 2023-08-25T09:40:46.362 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.41.8-1.el9.x86_64 171/177 2023-08-25T09:40:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:46.399 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:46.531 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:46.531 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-25T09:40:46.664 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-25T09:40:46.705 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-25T09:40:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.41.8-1.el9.x86_64 172/177 2023-08-25T09:40:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-25T09:40:46.747 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-25T09:40:46.790 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-25T09:40:46.868 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-25T09:40:46.900 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.41.8-1.el9.x86_64 173/177 2023-08-25T09:40:46.939 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libuuid-2.37.4-9.el9.x86_64 174/177 2023-08-25T09:40:46.973 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libsmartcols-2.37.4-9.el9.x86_64 175/177 2023-08-25T09:40:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libelf-0.188-3.el9.x86_64 176/177 2023-08-25T09:40:47.132 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-25T09:40:47.595 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-25T09:40:47.595 INFO:teuthology.orchestra.run.smithi149.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-25T09:40:47.595 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:52.227 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 1/177 2023-08-25T09:40:52.228 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 2/177 2023-08-25T09:40:52.228 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 3/177 2023-08-25T09:40:52.228 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 4/177 2023-08-25T09:40:52.228 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/177 2023-08-25T09:40:52.228 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 6/177 2023-08-25T09:40:52.229 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 7/177 2023-08-25T09:40:52.229 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 8/177 2023-08-25T09:40:52.229 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 9/177 2023-08-25T09:40:52.229 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 10/177 2023-08-25T09:40:52.230 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:40:52.231 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:40:52.231 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 13/177 2023-08-25T09:40:52.232 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_ 14/177 2023-08-25T09:40:52.232 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 15/177 2023-08-25T09:40:52.233 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:40:52.233 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_6 17/177 2023-08-25T09:40:52.233 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 18/177 2023-08-25T09:40:52.233 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 19/177 2023-08-25T09:40:52.234 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/177 2023-08-25T09:40:52.234 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9. 21/177 2023-08-25T09:40:52.234 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_6 22/177 2023-08-25T09:40:52.234 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 23/177 2023-08-25T09:40:52.235 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 24/177 2023-08-25T09:40:52.235 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 25/177 2023-08-25T09:40:52.235 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 26/177 2023-08-25T09:40:52.235 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 27/177 2023-08-25T09:40:52.251 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 28/177 2023-08-25T09:40:52.252 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/177 2023-08-25T09:40:52.252 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 30/177 2023-08-25T09:40:52.252 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 31/177 2023-08-25T09:40:52.252 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/177 2023-08-25T09:40:52.253 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/177 2023-08-25T09:40:52.253 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 34/177 2023-08-25T09:40:52.253 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/177 2023-08-25T09:40:52.253 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 36/177 2023-08-25T09:40:52.253 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 37/177 2023-08-25T09:40:52.253 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 38/177 2023-08-25T09:40:52.254 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-25T09:40:52.254 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-25T09:40:52.254 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-25T09:40:52.254 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-25T09:40:52.254 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-25T09:40:52.254 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-25T09:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-25T09:40:52.256 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-25T09:40:52.256 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-14.el9.x86_64 53/177 2023-08-25T09:40:52.256 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-25T09:40:52.256 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-25T09:40:52.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-25T09:40:52.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-25T09:40:52.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-25T09:40:52.257 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-25T09:40:52.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-25T09:40:52.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-25T09:40:52.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-25T09:40:52.258 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-25T09:40:52.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-25T09:40:52.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-25T09:40:52.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-25T09:40:52.259 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-25T09:40:52.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-25T09:40:52.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-25T09:40:52.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-25T09:40:52.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-25T09:40:52.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-25T09:40:52.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-25T09:40:52.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-25T09:40:52.261 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/177 2023-08-25T09:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 85/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 86/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/177 2023-08-25T09:40:52.263 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 91/177 2023-08-25T09:40:52.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-25T09:40:52.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-25T09:40:52.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-25T09:40:52.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-25T09:40:52.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-25T09:40:52.264 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-25T09:40:52.265 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-25T09:40:52.266 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-25T09:40:52.267 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-25T09:40:52.268 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 132/177 2023-08-25T09:40:52.269 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 136/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 138/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 140/177 2023-08-25T09:40:52.270 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 142/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-25T09:40:52.271 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libblkid-2.37.4-14.el9.x86_64 154/177 2023-08-25T09:40:52.272 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libfdisk-2.37.4-14.el9.x86_64 156/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libmount-2.37.4-14.el9.x86_64 158/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsmartcols-2.37.4-14.el9.x86_64 160/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-25T09:40:52.273 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-2.37.4-14.el9.x86_64 162/177 2023-08-25T09:40:52.274 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-25T09:40:52.274 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-25T09:40:52.274 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-25T09:40:52.274 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-25T09:40:52.274 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-25T09:40:52.274 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-2.37.4-14.el9.x86_64 168/177 2023-08-25T09:40:52.275 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-25T09:40:52.275 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-core-2.37.4-14.el9.x86_64 170/177 2023-08-25T09:40:52.275 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-25T09:40:52.275 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-user-2.37.4-14.el9.x86_64 172/177 2023-08-25T09:40:52.276 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-25T09:40:52.276 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-25T09:40:52.276 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-25T09:40:52.276 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-25T09:40:53.152 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.0.7-2.el9.x86_64 177/177 2023-08-25T09:40:53.153 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 1/177 2023-08-25T09:40:53.153 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 2/177 2023-08-25T09:40:53.153 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 3/177 2023-08-25T09:40:53.153 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 4/177 2023-08-25T09:40:53.153 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/177 2023-08-25T09:40:53.153 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 6/177 2023-08-25T09:40:53.154 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 7/177 2023-08-25T09:40:53.154 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 8/177 2023-08-25T09:40:53.154 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 9/177 2023-08-25T09:40:53.154 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 10/177 2023-08-25T09:40:53.155 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 11/177 2023-08-25T09:40:53.155 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 12/177 2023-08-25T09:40:53.155 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 13/177 2023-08-25T09:40:53.156 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_ 14/177 2023-08-25T09:40:53.156 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 15/177 2023-08-25T09:40:53.156 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 16/177 2023-08-25T09:40:53.157 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_6 17/177 2023-08-25T09:40:53.157 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86 18/177 2023-08-25T09:40:53.157 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 19/177 2023-08-25T09:40:53.157 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/177 2023-08-25T09:40:53.158 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9. 21/177 2023-08-25T09:40:53.158 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_6 22/177 2023-08-25T09:40:53.158 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 23/177 2023-08-25T09:40:53.158 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 24/177 2023-08-25T09:40:53.158 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 25/177 2023-08-25T09:40:53.159 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 26/177 2023-08-25T09:40:53.159 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 27/177 2023-08-25T09:40:53.159 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 28/177 2023-08-25T09:40:53.159 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/177 2023-08-25T09:40:53.159 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noa 30/177 2023-08-25T09:40:53.160 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.n 31/177 2023-08-25T09:40:53.160 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/177 2023-08-25T09:40:53.160 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/177 2023-08-25T09:40:53.160 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 34/177 2023-08-25T09:40:53.161 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/177 2023-08-25T09:40:53.161 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 36/177 2023-08-25T09:40:53.161 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 37/177 2023-08-25T09:40:53.161 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 38/177 2023-08-25T09:40:53.162 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/177 2023-08-25T09:40:53.162 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/177 2023-08-25T09:40:53.162 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/177 2023-08-25T09:40:53.162 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 42/177 2023-08-25T09:40:53.162 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : jq-1.6-15.el9.x86_64 47/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/177 2023-08-25T09:40:53.163 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-14.el9.x86_64 53/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/177 2023-08-25T09:40:53.164 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 59/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/177 2023-08-25T09:40:53.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/177 2023-08-25T09:40:53.166 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/177 2023-08-25T09:40:53.167 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/177 2023-08-25T09:40:53.167 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/177 2023-08-25T09:40:53.167 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/177 2023-08-25T09:40:53.167 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/177 2023-08-25T09:40:53.167 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/177 2023-08-25T09:40:53.168 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/177 2023-08-25T09:40:53.168 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 85/177 2023-08-25T09:40:53.169 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 86/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 91/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-36.el9.x86_64 92/177 2023-08-25T09:40:53.170 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 93/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 94/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 95/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 96/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 97/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 98/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 99/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 100/177 2023-08-25T09:40:53.171 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 101/177 2023-08-25T09:40:53.172 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 102/177 2023-08-25T09:40:53.172 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 103/177 2023-08-25T09:40:53.172 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 104/177 2023-08-25T09:40:53.172 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 105/177 2023-08-25T09:40:53.172 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.22.0-1.el9.noarch 106/177 2023-08-25T09:40:53.172 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 107/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 108/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 109/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 110/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 111/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 112/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 113/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 114/177 2023-08-25T09:40:53.173 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 115/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 116/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 117/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 118/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 119/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 121/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 122/177 2023-08-25T09:40:53.174 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 123/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 124/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 125/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 126/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 127/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 128/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 129/177 2023-08-25T09:40:53.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-2.el9.x86_64 130/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 131/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 132/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 133/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 134/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 135/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 136/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.41.8-1.el9.x86_64 137/177 2023-08-25T09:40:53.176 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 138/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.41.8-1.el9.x86_64 139/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 140/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.41.8-1.el9.x86_64 141/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 142/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.41.8-1.el9.x86_64 143/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el9.x86_64 145/177 2023-08-25T09:40:53.177 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.188-3.el9.x86_64 147/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.188-3.el9.x86_64 149/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 150/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : iproute-6.0.0-2.el9.x86_64 151/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 152/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : iproute-tc-6.0.0-2.el9.x86_64 153/177 2023-08-25T09:40:53.178 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libblkid-2.37.4-14.el9.x86_64 154/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libblkid-2.37.4-9.el9.x86_64 155/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libfdisk-2.37.4-14.el9.x86_64 156/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libfdisk-2.37.4-9.el9.x86_64 157/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libmount-2.37.4-14.el9.x86_64 158/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libmount-2.37.4-9.el9.x86_64 159/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsmartcols-2.37.4-14.el9.x86_64 160/177 2023-08-25T09:40:53.179 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libsmartcols-2.37.4-9.el9.x86_64 161/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-2.37.4-14.el9.x86_64 162/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-2.37.4-9.el9.x86_64 163/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 164/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.0.7-2.el9.x86_64 165/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 166/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.0.7-2.el9.x86_64 167/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-2.37.4-14.el9.x86_64 168/177 2023-08-25T09:40:53.180 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-2.37.4-9.el9.x86_64 169/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-core-2.37.4-14.el9.x86_64 170/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-core-2.37.4-9.el9.x86_64 171/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-user-2.37.4-14.el9.x86_64 172/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : util-linux-user-2.37.4-9.el9.x86_64 173/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 174/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsdump-3.1.10-1.el9.x86_64 175/177 2023-08-25T09:40:53.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 176/177 2023-08-25T09:40:54.669 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-25T09:40:54.669 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:54.669 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-25T09:40:54.670 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: libblkid-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: libfdisk-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: libmount-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.671 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: libsmartcols-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-core-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.672 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-user-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-25T09:40:54.673 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.674 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.675 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.676 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.676 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.676 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.676 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.676 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.676 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:54.677 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-25T09:40:54.677 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2023-08-25T09:40:54.677 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-25T09:40:54.677 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-15.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-25T09:40:54.678 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-25T09:40:54.679 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-25T09:40:54.680 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-25T09:40:54.680 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.680 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.680 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-25T09:40:54.680 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.680 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-14.el9.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-25T09:40:54.681 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-25T09:40:54.682 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:54.682 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-25T09:40:54.682 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-13.11-1.el9.x86_64 2023-08-25T09:40:54.682 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-25T09:40:54.682 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-25T09:40:54.682 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-25T09:40:54.683 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-25T09:40:54.683 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-25T09:40:54.684 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-25T09:40:54.684 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-25T09:40:54.685 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.685 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.685 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-25T09:40:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-25T09:40:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-25T09:40:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-25T09:40:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-25T09:40:54.686 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-25T09:40:54.687 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-25T09:40:54.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-25T09:40:54.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-25T09:40:54.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-25T09:40:54.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-25T09:40:54.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-25T09:40:54.688 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-25T09:40:54.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-25T09:40:54.690 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-25T09:40:54.690 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2023-08-25T09:40:54.690 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-25T09:40:54.691 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.692 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.692 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-25T09:40:54.692 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-25T09:40:54.692 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.692 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-25T09:40:54.692 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-25T09:40:54.693 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-2.el9.x86_64 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-25T09:40:54.694 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-25T09:40:54.695 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-25T09:40:54.695 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-25T09:40:54.696 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-25T09:40:54.696 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:40:54.696 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-08-25T09:40:55.347 DEBUG:teuthology.parallel:result is None 2023-08-25T09:40:56.261 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-5.14.2-1.el9.x86_64 177/177 2023-08-25T09:40:56.261 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:56.262 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2023-08-25T09:40:56.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:56.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:56.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:56.263 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.44.0-2.el9.x86_64 2023-08-25T09:40:56.263 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client-0.189-3.el9.x86_64 2023-08-25T09:40:56.263 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-0.189-3.el9.x86_64 2023-08-25T09:40:56.263 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs-0.189-3.el9.x86_64 2023-08-25T09:40:56.264 INFO:teuthology.orchestra.run.smithi121.stdout: iproute-6.2.0-5.el9.x86_64 2023-08-25T09:40:56.264 INFO:teuthology.orchestra.run.smithi121.stdout: iproute-tc-6.2.0-5.el9.x86_64 2023-08-25T09:40:56.264 INFO:teuthology.orchestra.run.smithi121.stdout: libblkid-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.264 INFO:teuthology.orchestra.run.smithi121.stdout: libfdisk-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.264 INFO:teuthology.orchestra.run.smithi121.stdout: libmount-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.265 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.265 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.265 INFO:teuthology.orchestra.run.smithi121.stdout: libsmartcols-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.265 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.265 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:56.265 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:56.266 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.266 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-core-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.266 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-user-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.266 INFO:teuthology.orchestra.run.smithi121.stdout: xfsdump-3.1.12-3.el9.x86_64 2023-08-25T09:40:56.266 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-5.19.0-4.el9.x86_64 2023-08-25T09:40:56.266 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.267 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.268 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.268 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.268 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.268 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.268 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.268 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el9.noarch 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-08-25T09:40:56.271 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: fmt-8.1.1-5.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-15.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: jq-1.6-15.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-08-25T09:40:56.272 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-9.el9.x86_64 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2023-08-25T09:40:56.273 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-08-25T09:40:56.274 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-08-25T09:40:56.274 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-08-25T09:40:56.274 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.274 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.274 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-45.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-14.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-08-25T09:40:56.275 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-08-25T09:40:56.276 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.21-2.el9.x86_64 2023-08-25T09:40:56.276 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-08-25T09:40:56.276 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-08-25T09:40:56.276 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-08-25T09:40:56.276 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.11-1.el9.x86_64 2023-08-25T09:40:56.277 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-08-25T09:40:56.277 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-08-25T09:40:56.277 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.11-1.el9.x86_64 2023-08-25T09:40:56.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-08-25T09:40:56.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2023-08-25T09:40:56.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-08-25T09:40:56.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-08-25T09:40:56.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-08-25T09:40:56.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-08-25T09:40:56.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-08-25T09:40:56.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-08-25T09:40:56.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-08-25T09:40:56.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.16-1.el9.x86_64 2023-08-25T09:40:56.282 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.22.0-1.el9.noarch 2023-08-25T09:40:56.282 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-08-25T09:40:56.282 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-08-25T09:40:56.283 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-08-25T09:40:56.284 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-08-25T09:40:56.284 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-08-25T09:40:56.284 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-08-25T09:40:56.284 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2023-08-25T09:40:56.284 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-08-25T09:40:56.284 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2023-08-25T09:40:56.285 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2023-08-25T09:40:56.286 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-08-25T09:40:56.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-08-25T09:40:56.288 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2023-08-25T09:40:56.288 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-08-25T09:40:56.288 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.7-6.el9.noarch 2023-08-25T09:40:56.288 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-08-25T09:40:56.288 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-08-25T09:40:56.288 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-08-25T09:40:56.289 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.289 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.289 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el9.x86_64 2023-08-25T09:40:56.289 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-2.el9.x86_64 2023-08-25T09:40:56.289 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-5.el9.x86_64 2023-08-25T09:40:56.289 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2023-08-25T09:40:56.290 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2023-08-25T09:40:56.290 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-08-25T09:40:56.290 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-08-25T09:40:56.290 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-36.el9.x86_64 2023-08-25T09:40:56.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:40:56.291 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-08-25T09:40:56.903 DEBUG:teuthology.parallel:result is None 2023-08-25T09:40:56.904 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:40:57.046 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T09:40:57.072 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-5703.gba6b39e4.el9 2023-08-25T09:40:57.072 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el9 2023-08-25T09:40:57.073 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T09:40:57.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:40:57.289 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T09:40:57.311 INFO:teuthology.orchestra.run.smithi121.stdout:18.0.0-5703.gba6b39e4.el9 2023-08-25T09:40:57.312 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el9 2023-08-25T09:40:57.312 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T09:40:57.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T09:40:57.522 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T09:40:57.581 INFO:teuthology.orchestra.run.smithi149.stdout:18.0.0-5703.gba6b39e4.el9 2023-08-25T09:40:57.582 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el9 2023-08-25T09:40:57.582 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T09:40:57.583 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-25T09:40:57.583 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:40:57.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T09:40:57.618 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:40:57.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T09:40:57.650 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:40:57.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T09:40:57.729 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-25T09:40:57.730 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:40:57.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T09:40:57.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T09:40:57.832 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:40:57.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T09:40:57.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T09:40:57.977 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:40:57.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T09:40:58.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T09:40:58.173 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-25T09:40:58.173 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:40:58.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T09:40:58.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T09:40:58.276 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:40:58.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T09:40:58.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T09:40:58.371 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:40:58.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T09:40:58.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T09:40:58.598 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-25T09:40:58.599 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:40:58.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T09:40:58.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T09:40:58.700 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:40:58.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T09:40:58.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T09:40:58.797 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:40:58.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T09:40:58.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T09:40:58.987 INFO:teuthology.run_tasks:Running task ceph... 2023-08-25T09:40:59.067 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-25T09:40:59.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-08-25T09:40:59.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2023-08-25T09:40:59.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-08-25T09:40:59.152 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-25T09:40:59.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T09:40:59.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T09:40:59.158 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T09:40:59.229 INFO:tasks.ceph:Creating extra log directories... 2023-08-25T09:40:59.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T09:40:59.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T09:40:59.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T09:40:59.322 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-25T09:40:59.323 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-25T09:40:59.324 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-25T09:40:59.324 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:40:59.325 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T09:40:59.342 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.489 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:40:59.490 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T09:40:59.505 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.654 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:40:59.654 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T09:40:59.698 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T09:41:00.004 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-25T09:41:00.005 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-25T09:41:00.006 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379318', 'branch': 'wip-rishabh-2023aug3-b5', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': None, 'first_in_suite': False, 'job_id': '7379318', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-25_06:38:25-fs-wip-rishabh-2023aug3-b5-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023aug3-b5'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'test-nfs-pr-52556', 'sha1': '4b369cf18ed1391a426ab4ae86da834e9c074f81'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'test-nfs-pr-52556', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_4b369cf18ed1391a426ab4ae86da834e9c074f81/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '4b369cf18ed1391a426ab4ae86da834e9c074f81', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFcRDpPGn5lf9rB22obTXJ0un+eDrFn9qE5/Eda1K5OZmjx9TllosIHLNlyvFkzZKyuY3ejIQQJNO5HbWhmPAj8=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKs2YmSHlPXN15JCmQOohZcsXPH8esRfUYpX9m8oY+HazBV37eEHUCZAumOBxxNUJ/KENJ5Th0y2bTpflK4mfjM=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeJnt5MoAMFJQCisA3+O5+BC50e/or24bn0+QgPGFX33HcVpD3YBwvE8CZcV0kcgYhQ1cvz1za+KCrgSk5ap8s='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-25_06:38:25', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-25T09:41:00.008 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T09:41:00.012 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T09:41:00.016 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T09:41:00.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T09:41:00.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T09:41:00.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T09:41:00.177 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:00.177 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T09:41:00.195 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T09:41:00.196 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-08-25T09:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T09:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:00.250 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-08-25T09:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-08-25 09:40:34.487001870 +0000 2023-08-25T09:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-08-25 09:33:43.843758419 +0000 2023-08-25T09:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-08-25 09:33:43.843758419 +0000 2023-08-25T09:41:00.251 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-08-25 09:33:43.843758419 +0000 2023-08-25T09:41:00.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T09:41:00.322 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-08-25T09:41:00.322 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-08-25T09:41:00.322 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000434742 s, 1.2 MB/s 2023-08-25T09:41:00.323 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T09:41:00.379 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-08-25T09:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T09:41:00.435 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-08-25T09:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:00.436 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-08-25 09:40:34.488001847 +0000 2023-08-25T09:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-08-25 09:33:44.367746659 +0000 2023-08-25T09:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-08-25 09:33:44.367746659 +0000 2023-08-25T09:41:00.437 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-08-25 09:33:44.367746659 +0000 2023-08-25T09:41:00.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T09:41:00.501 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-08-25T09:41:00.501 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-08-25T09:41:00.502 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000361348 s, 1.4 MB/s 2023-08-25T09:41:00.502 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T09:41:00.557 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-08-25T09:41:00.612 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T09:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:00.613 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 687 Links: 1 2023-08-25T09:41:00.614 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:00.615 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-08-25 09:40:34.488001847 +0000 2023-08-25T09:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-08-25 09:33:44.868735416 +0000 2023-08-25T09:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-08-25 09:33:44.868735416 +0000 2023-08-25T09:41:00.616 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-08-25 09:33:44.868735416 +0000 2023-08-25T09:41:00.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T09:41:00.678 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-08-25T09:41:00.678 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-08-25T09:41:00.679 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000351521 s, 1.5 MB/s 2023-08-25T09:41:00.680 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T09:41:00.735 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-08-25T09:41:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T09:41:00.791 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:00.791 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 704 Links: 1 2023-08-25T09:41:00.791 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:00.791 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:00.792 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-08-25 09:40:34.488001847 +0000 2023-08-25T09:41:00.792 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-08-25 09:33:45.374724060 +0000 2023-08-25T09:41:00.792 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-08-25 09:33:45.374724060 +0000 2023-08-25T09:41:00.792 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-08-25 09:33:45.374724060 +0000 2023-08-25T09:41:00.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T09:41:00.857 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-08-25T09:41:00.858 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-08-25T09:41:00.858 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000383639 s, 1.3 MB/s 2023-08-25T09:41:00.859 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T09:41:00.914 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:00.915 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:00.915 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T09:41:00.934 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T09:41:00.935 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2023-08-25T09:41:00.991 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T09:41:00.992 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:00.992 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-08-25T09:41:00.992 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:00.992 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:00.992 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-25 09:40:47.294808852 +0000 2023-08-25T09:41:00.993 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-25 09:33:43.853086635 +0000 2023-08-25T09:41:00.993 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-25 09:33:43.853086635 +0000 2023-08-25T09:41:00.993 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-08-25 09:33:43.853086635 +0000 2023-08-25T09:41:00.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T09:41:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-25T09:41:01.060 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-25T09:41:01.060 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000336049 s, 1.5 MB/s 2023-08-25T09:41:01.061 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T09:41:01.118 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2023-08-25T09:41:01.174 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T09:41:01.175 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:01.175 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-08-25T09:41:01.175 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-25 09:40:47.294808852 +0000 2023-08-25T09:41:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-25 09:33:44.367080375 +0000 2023-08-25T09:41:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-25 09:33:44.367080375 +0000 2023-08-25T09:41:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-08-25 09:33:44.367080375 +0000 2023-08-25T09:41:01.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T09:41:01.242 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-25T09:41:01.242 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-25T09:41:01.242 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000302584 s, 1.7 MB/s 2023-08-25T09:41:01.244 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T09:41:01.301 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2023-08-25T09:41:01.357 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T09:41:01.357 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:01.358 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 687 Links: 1 2023-08-25T09:41:01.358 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:01.358 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:01.358 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-25 09:40:47.294808852 +0000 2023-08-25T09:41:01.358 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-25 09:33:44.893073970 +0000 2023-08-25T09:41:01.359 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-25 09:33:44.893073970 +0000 2023-08-25T09:41:01.360 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-08-25 09:33:44.893073970 +0000 2023-08-25T09:41:01.360 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T09:41:01.425 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-25T09:41:01.425 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-25T09:41:01.425 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000334459 s, 1.5 MB/s 2023-08-25T09:41:01.426 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T09:41:01.483 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2023-08-25T09:41:01.538 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T09:41:01.538 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T09:41:01.538 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 706 Links: 1 2023-08-25T09:41:01.538 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T09:41:01.539 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T09:41:01.539 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-08-25 09:40:47.295808839 +0000 2023-08-25T09:41:01.539 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-08-25 09:33:45.393067880 +0000 2023-08-25T09:41:01.539 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-08-25 09:33:45.393067880 +0000 2023-08-25T09:41:01.539 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-08-25 09:33:45.393067880 +0000 2023-08-25T09:41:01.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T09:41:01.604 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-08-25T09:41:01.604 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-08-25T09:41:01.605 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000337962 s, 1.5 MB/s 2023-08-25T09:41:01.606 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T09:41:01.662 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:01.662 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T09:41:01.662 INFO:tasks.ceph:Generating config... 2023-08-25T09:41:01.663 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-25T09:41:01.664 INFO:tasks.ceph:[client] debug client = 20 2023-08-25T09:41:01.664 INFO:tasks.ceph:[client] debug ms = 1 2023-08-25T09:41:01.664 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-25T09:41:01.664 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-25T09:41:01.665 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-08-25T09:41:01.665 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-25T09:41:01.665 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-25T09:41:01.666 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-25T09:41:01.666 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-25T09:41:01.666 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-25T09:41:01.666 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-25T09:41:01.667 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-25T09:41:01.667 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-25T09:41:01.667 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-25T09:41:01.667 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-25T09:41:01.668 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-25T09:41:01.668 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-25T09:41:01.668 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-25T09:41:01.668 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-25T09:41:01.668 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-25T09:41:01.669 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-25T09:41:01.669 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-25T09:41:01.669 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-25T09:41:01.669 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-25T09:41:01.670 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-25T09:41:01.670 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-25T09:41:01.670 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-25T09:41:01.670 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-25T09:41:01.671 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-25T09:41:01.671 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-25T09:41:01.671 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-25T09:41:01.671 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-25T09:41:01.671 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-25T09:41:01.671 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-25T09:41:01.672 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-25T09:41:01.672 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-25T09:41:01.672 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-25T09:41:01.672 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-25T09:41:01.673 INFO:tasks.ceph:Setting up mon.a... 2023-08-25T09:41:01.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-25T09:41:01.720 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2023-08-25T09:41:01.723 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-25T09:41:01.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T09:41:01.793 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89'), ('mon.b', '172.21.15.121'), ('mon.c', '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]')] 2023-08-25T09:41:01.794 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-25T09:41:01.796 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:01.797 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T09:41:01.847 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --add b 172.21.15.121 --addv c '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:01.930 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:01.931 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid f41429b4-33b6-4950-8ef3-07360119fda9 2023-08-25T09:41:01.931 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = pacific 2023-08-25T09:41:01.931 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2023-08-25T09:41:01.931 INFO:teuthology.orchestra.run.smithi089.stdout:fsid f41429b4-33b6-4950-8ef3-07360119fda9 2023-08-25T09:41:01.931 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2023-08-25T09:41:01.929999+0000 2023-08-25T09:41:01.932 INFO:teuthology.orchestra.run.smithi089.stdout:created 2023-08-25T09:41:01.929999+0000 2023-08-25T09:41:01.932 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 16 (pacific) 2023-08-25T09:41:01.932 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2023-08-25T09:41:01.932 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2023-08-25T09:41:01.932 INFO:teuthology.orchestra.run.smithi089.stdout:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2023-08-25T09:41:01.932 INFO:teuthology.orchestra.run.smithi089.stdout:2: [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] mon.c 2023-08-25T09:41:01.933 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-25T09:41:01.934 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T09:41:01.989 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f41429b4-33b6-4950-8ef3-07360119fda9... 2023-08-25T09:41:01.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T09:41:02.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T09:41:02.037 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T09:41:02.082 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-08-25T09:41:02.083 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-08-25T09:41:02.083 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T09:41:02.083 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-08-25T09:41:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-08-25T09:41:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-08-25T09:41:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-08-25T09:41:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-08-25T09:41:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-08-25T09:41:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-08-25T09:41:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-08-25T09:41:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-08-25T09:41:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-08-25T09:41:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.89,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn min per osd = 0 2023-08-25T09:41:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = f41429b4-33b6-4950-8ef3-07360119fda9 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-08-25T09:41:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-08-25T09:41:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-08-25T09:41:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-08-25T09:41:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-08-25T09:41:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-08-25T09:41:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-08-25T09:41:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-08-25T09:41:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-08-25T09:41:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-08-25T09:41:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-08-25T09:41:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-08-25T09:41:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-08-25T09:41:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-08-25T09:41:02.107 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2023-08-25T09:41:02.107 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2023-08-25T09:41:02.107 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T09:41:02.107 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2023-08-25T09:41:02.107 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2023-08-25T09:41:02.108 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T09:41:02.109 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2023-08-25T09:41:02.110 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.111 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2023-08-25T09:41:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.89,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn min per osd = 0 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = f41429b4-33b6-4950-8ef3-07360119fda9 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2023-08-25T09:41:02.113 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2023-08-25T09:41:02.114 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.115 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2023-08-25T09:41:02.116 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2023-08-25T09:41:02.117 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2023-08-25T09:41:02.118 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-08-25T09:41:02.119 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-25T09:41:02.120 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2023-08-25T09:41:02.121 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T09:41:02.122 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: mon op complaint time = 120 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-08-25T09:41:02.123 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: client mount timeout = 600 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2023-08-25T09:41:02.124 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2023-08-25T09:41:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2023-08-25T09:41:02.126 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2023-08-25T09:41:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds = 20 2023-08-25T09:41:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds balancer = 20 2023-08-25T09:41:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-08-25T09:41:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug frag = True 2023-08-25T09:41:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug scatterstat = True 2023-08-25T09:41:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: mds op complaint time = 180 2023-08-25T09:41:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: mds verify scatter = True 2023-08-25T09:41:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2023-08-25T09:41:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2023-08-25T09:41:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2023-08-25T09:41:02.221 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-08-25T09:41:02.221 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-08-25T09:41:02.221 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T09:41:02.222 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-08-25T09:41:02.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.222 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-08-25T09:41:02.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-08-25T09:41:02.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T09:41:02.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.224 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-08-25T09:41:02.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-08-25T09:41:02.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-08-25T09:41:02.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-08-25T09:41:02.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-08-25T09:41:02.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-08-25T09:41:02.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-08-25T09:41:02.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T09:41:02.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T09:41:02.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-08-25T09:41:02.226 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.226 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T09:41:02.227 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.227 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-08-25T09:41:02.227 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-08-25T09:41:02.228 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-08-25T09:41:02.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-08-25T09:41:02.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-08-25T09:41:02.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.89,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2023-08-25T09:41:02.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn min per osd = 0 2023-08-25T09:41:02.229 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2023-08-25T09:41:02.229 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = f41429b4-33b6-4950-8ef3-07360119fda9 2023-08-25T09:41:02.229 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.230 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-08-25T09:41:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-08-25T09:41:02.232 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2023-08-25T09:41:02.233 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2023-08-25T09:41:02.234 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-08-25T09:41:02.234 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-08-25T09:41:02.234 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2023-08-25T09:41:02.234 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2023-08-25T09:41:02.234 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-08-25T09:41:02.234 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-08-25T09:41:02.235 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2023-08-25T09:41:02.235 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T09:41:02.235 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-08-25T09:41:02.235 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-08-25T09:41:02.235 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-08-25T09:41:02.235 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-08-25T09:41:02.236 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-08-25T09:41:02.236 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.236 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-08-25T09:41:02.236 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-08-25T09:41:02.236 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-08-25T09:41:02.236 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-08-25T09:41:02.237 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-08-25T09:41:02.238 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-08-25T09:41:02.239 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-08-25T09:41:02.239 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.239 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T09:41:02.239 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T09:41:02.239 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T09:41:02.239 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.240 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T09:41:02.240 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T09:41:02.240 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T09:41:02.240 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.240 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-08-25T09:41:02.240 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-08-25T09:41:02.241 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-08-25T09:41:02.242 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-08-25T09:41:02.243 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-08-25T09:41:02.244 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-08-25T09:41:02.245 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-08-25T09:41:02.245 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-08-25T09:41:02.267 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-25T09:41:02.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-25T09:41:02.324 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-25T09:41:02.324 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:02.324 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-25T09:41:02.338 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:02.338 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-25T09:41:02.392 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-08-25T09:41:02.392 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:02.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T09:41:02.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T09:41:02.471 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:02.471 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:02.526 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2023-08-25T09:41:02.526 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:02.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T09:41:02.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T09:41:02.568 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:02.569 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:02.623 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-08-25T09:41:02.623 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:41:02.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T09:41:02.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T09:41:02.787 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:41:02.787 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:02.888 INFO:tasks.ceph:Setting up mon nodes... 2023-08-25T09:41:02.889 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-25T09:41:02.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T09:41:02.944 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T09:41:02.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T09:41:03.015 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T09:41:03.017 INFO:tasks.ceph:Setting up mds nodes... 2023-08-25T09:41:03.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T09:41:03.073 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T09:41:03.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-25T09:41:03.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T09:41:03.200 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T09:41:03.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-25T09:41:03.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T09:41:03.295 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T09:41:03.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-25T09:41:03.324 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-25T09:41:03.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-25T09:41:03.468 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-25T09:41:03.518 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-25T09:41:03.519 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T09:41:03.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-25T09:41:03.549 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:03.549 INFO:tasks.ceph:role: osd.0 2023-08-25T09:41:03.550 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-08-25T09:41:03.550 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T09:41:03.630 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:03.630 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:03.630 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:03.630 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:03.631 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:03.631 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:03.631 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:03.631 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:03.631 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:03.631 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:04.142 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-08-25T09:41:04.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-08-25T09:41:04.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-25T09:41:04.277 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-25T09:41:04.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-25T09:41:04.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:04.389 INFO:tasks.ceph:role: osd.1 2023-08-25T09:41:04.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-08-25T09:41:04.390 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T09:41:04.465 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:04.466 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:04.466 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:04.466 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:04.466 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:04.466 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:04.466 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:04.467 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:04.467 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:04.467 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:04.911 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-08-25T09:41:04.913 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-08-25T09:41:04.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-25T09:41:05.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-25T09:41:05.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-25T09:41:05.118 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:05.119 INFO:tasks.ceph:role: osd.2 2023-08-25T09:41:05.119 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-08-25T09:41:05.120 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T09:41:05.191 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:05.192 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:05.192 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:05.192 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:05.193 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:05.193 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:05.193 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:05.193 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:05.193 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:05.193 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:05.683 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-08-25T09:41:05.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-08-25T09:41:05.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-25T09:41:05.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-25T09:41:05.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-25T09:41:05.923 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:05.924 INFO:tasks.ceph:role: osd.3 2023-08-25T09:41:05.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-08-25T09:41:05.925 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T09:41:05.997 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:05.997 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:05.997 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:05.998 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:05.998 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:05.998 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:05.998 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:05.998 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:05.999 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:05.999 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:06.501 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-08-25T09:41:06.503 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-08-25T09:41:06.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-25T09:41:06.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-25T09:41:06.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:06.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:06.784+0000 7fa168413500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-25T09:41:06.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:06.784+0000 7fa168413500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-25T09:41:06.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:06.784+0000 7fa168413500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T09:41:06.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:06.784+0000 7fa168413500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T09:41:06.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:06.784+0000 7fa168413500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T09:41:06.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:06.785+0000 7fa168413500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-25T09:41:09.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-25T09:41:09.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:09.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:09.752+0000 7f02c4789500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-25T09:41:09.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:09.752+0000 7f02c4789500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-25T09:41:09.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:09.752+0000 7f02c4789500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T09:41:09.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:09.752+0000 7f02c4789500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T09:41:09.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:09.752+0000 7f02c4789500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T09:41:09.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:09.753+0000 7f02c4789500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-25T09:41:12.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-25T09:41:12.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:12.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:12.724+0000 7f3b2b5e2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-25T09:41:12.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:12.724+0000 7f3b2b5e2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-25T09:41:12.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:12.725+0000 7f3b2b5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T09:41:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:12.725+0000 7f3b2b5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T09:41:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:12.725+0000 7f3b2b5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T09:41:12.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:12.725+0000 7f3b2b5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-25T09:41:15.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-25T09:41:15.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:15.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:15.703+0000 7fbf45206500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-25T09:41:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:15.704+0000 7fbf45206500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-25T09:41:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:15.704+0000 7fbf45206500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T09:41:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:15.704+0000 7fbf45206500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T09:41:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:15.704+0000 7fbf45206500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T09:41:15.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:15.704+0000 7fbf45206500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-25T09:41:18.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-25T09:41:18.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-25T09:41:18.621 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:18.622 INFO:tasks.ceph:role: osd.4 2023-08-25T09:41:18.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-25T09:41:18.623 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T09:41:18.698 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:18.699 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:18.699 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:18.699 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:18.699 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:18.700 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:18.700 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:18.700 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:18.700 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:18.700 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:19.192 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-25T09:41:19.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-25T09:41:19.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-25T09:41:19.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-25T09:41:19.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-25T09:41:19.454 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:19.455 INFO:tasks.ceph:role: osd.5 2023-08-25T09:41:19.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-25T09:41:19.455 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T09:41:19.529 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:19.530 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:19.530 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:19.530 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:19.531 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:19.531 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:19.531 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:19.531 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:19.531 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:19.531 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:19.977 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-25T09:41:19.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-25T09:41:19.980 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-25T09:41:20.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-25T09:41:20.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-25T09:41:20.203 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:20.203 INFO:tasks.ceph:role: osd.6 2023-08-25T09:41:20.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-25T09:41:20.204 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T09:41:20.278 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:20.278 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:20.278 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:20.278 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:20.278 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:20.279 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:20.279 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:20.279 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:20.279 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:20.279 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:20.789 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-25T09:41:20.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-25T09:41:20.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-25T09:41:20.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-25T09:41:20.962 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-25T09:41:21.031 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T09:41:21.032 INFO:tasks.ceph:role: osd.7 2023-08-25T09:41:21.032 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2023-08-25T09:41:21.032 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T09:41:21.107 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T09:41:21.107 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T09:41:21.107 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T09:41:21.108 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-08-25T09:41:21.108 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T09:41:21.109 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-08-25T09:41:21.109 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T09:41:21.109 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-08-25T09:41:21.109 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T09:41:21.109 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T09:41:21.615 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-08-25T09:41:21.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-08-25T09:41:21.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-25T09:41:21.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-25T09:41:21.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:21.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:21.877+0000 7f146d22a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-25T09:41:21.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:21.877+0000 7f146d22a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-25T09:41:21.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:21.877+0000 7f146d22a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T09:41:21.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:21.877+0000 7f146d22a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T09:41:21.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:21.877+0000 7f146d22a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T09:41:21.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:21.878+0000 7f146d22a500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-25T09:41:24.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-25T09:41:24.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:24.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:24.851+0000 7ff96e42b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-25T09:41:24.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:24.852+0000 7ff96e42b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-25T09:41:24.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:24.852+0000 7ff96e42b500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T09:41:24.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:24.852+0000 7ff96e42b500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T09:41:24.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:24.852+0000 7ff96e42b500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T09:41:24.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:24.852+0000 7ff96e42b500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-25T09:41:27.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-25T09:41:27.733 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:27.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:27.821+0000 7f4a3c71d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-25T09:41:27.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:27.821+0000 7f4a3c71d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-25T09:41:27.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:27.821+0000 7f4a3c71d500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T09:41:27.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:27.821+0000 7f4a3c71d500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T09:41:27.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:27.821+0000 7f4a3c71d500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T09:41:27.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:27.821+0000 7f4a3c71d500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-25T09:41:30.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:41:30.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:41:30.020 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:41:30.674 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-25T09:41:30.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:30.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:30.794+0000 7f4dd4e1d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-25T09:41:30.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:30.795+0000 7f4dd4e1d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-25T09:41:30.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:30.795+0000 7f4dd4e1d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T09:41:30.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:30.795+0000 7f4dd4e1d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T09:41:30.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:30.795+0000 7f4dd4e1d500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T09:41:30.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:30.795+0000 7f4dd4e1d500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-25T09:41:33.651 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-25T09:41:33.683 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-25T09:41:33.683 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:33.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-25T09:41:33.717 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:33.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-25T09:41:33.788 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:33.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-25T09:41:33.858 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:33.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-25T09:41:33.927 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:33.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-25T09:41:33.996 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:33.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-25T09:41:34.064 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:34.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-25T09:41:34.133 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:34.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-25T09:41:34.171 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:34.171 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-25T09:41:34.249 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:34.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-25T09:41:34.323 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:34.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-25T09:41:34.413 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:34.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-25T09:41:34.483 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:34.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-25T09:41:34.564 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:41:34.564 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-25T09:41:34.627 INFO:tasks.ceph:Adding keys to all mons... 2023-08-25T09:41:34.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T09:41:34.633 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T09:41:34.658 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAud+hkyIRCOBAAS2vHDh1qp1cfM1j92+Mp9w== 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAvd+hklWpRBBAALBGH8HDScvn2SIxoJFffIw== 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAvd+hk2YHmCxAAPEWEfQXOA9Pe8hu3GW0o7Q== 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-08-25T09:41:34.659 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAyd+hkZxrLLhAADuCjEkTSiFApavGK3Lo+jw== 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA1d+hkrSXjLBAADzsti2P+PLGx2ZgMGOu85g== 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA4d+hkB0I9KxAA+JFDCE2XqTP6B8GGQpiw2w== 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA7d+hkyFj/KRAAETTB4JI7dOxF7jMuNV5SyA== 2023-08-25T09:41:34.660 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAvd+hk6TjgABAA+ZkeOb3zGhPR8sI58e7rSQ== 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAvd+hk+2aCERAAHEuatK/IsLr4hmgzMWP9ig== 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBBd+hkMLZaNBAA8knQnzlTYWHWnVuzkGjIIg== 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBEd+hkGA/RMhAAPR0YJQB7qqcotuDmpjsRIA== 2023-08-25T09:41:34.661 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-08-25T09:41:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBHd+hkxkj+MBAAspeQkYZhfIp1bR3xDPI2vg== 2023-08-25T09:41:34.662 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-08-25T09:41:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBKd+hkkcNrLxAAMtlRn9YWXHrEDjkIBb9rHg== 2023-08-25T09:41:34.662 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-08-25T09:41:34.662 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAvd+hkle7ZGxAAQN9Z+CBij65mSNnJP4/B3g== 2023-08-25T09:41:34.663 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2023-08-25T09:41:34.664 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAud+hkyIRCOBAAS2vHDh1qp1cfM1j92+Mp9w== 2023-08-25T09:41:34.664 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2023-08-25T09:41:34.664 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAvd+hklWpRBBAALBGH8HDScvn2SIxoJFffIw== 2023-08-25T09:41:34.665 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2023-08-25T09:41:34.665 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAvd+hk2YHmCxAAPEWEfQXOA9Pe8hu3GW0o7Q== 2023-08-25T09:41:34.665 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2023-08-25T09:41:34.665 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAyd+hkZxrLLhAADuCjEkTSiFApavGK3Lo+jw== 2023-08-25T09:41:34.665 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2023-08-25T09:41:34.666 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA1d+hkrSXjLBAADzsti2P+PLGx2ZgMGOu85g== 2023-08-25T09:41:34.666 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2023-08-25T09:41:34.666 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA4d+hkB0I9KxAA+JFDCE2XqTP6B8GGQpiw2w== 2023-08-25T09:41:34.666 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2023-08-25T09:41:34.666 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA7d+hkyFj/KRAAETTB4JI7dOxF7jMuNV5SyA== 2023-08-25T09:41:34.666 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2023-08-25T09:41:34.667 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAvd+hk6TjgABAA+ZkeOb3zGhPR8sI58e7rSQ== 2023-08-25T09:41:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2023-08-25T09:41:34.667 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAvd+hk+2aCERAAHEuatK/IsLr4hmgzMWP9ig== 2023-08-25T09:41:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2023-08-25T09:41:34.667 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBBd+hkMLZaNBAA8knQnzlTYWHWnVuzkGjIIg== 2023-08-25T09:41:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2023-08-25T09:41:34.668 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBEd+hkGA/RMhAAPR0YJQB7qqcotuDmpjsRIA== 2023-08-25T09:41:34.668 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2023-08-25T09:41:34.668 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBHd+hkxkj+MBAAspeQkYZhfIp1bR3xDPI2vg== 2023-08-25T09:41:34.668 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2023-08-25T09:41:34.668 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBKd+hkkcNrLxAAMtlRn9YWXHrEDjkIBb9rHg== 2023-08-25T09:41:34.668 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2023-08-25T09:41:34.669 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAvd+hkle7ZGxAAQN9Z+CBij65mSNnJP4/B3g== 2023-08-25T09:41:34.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T09:41:34.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T09:41:34.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T09:41:34.788 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T09:41:34.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T09:41:34.856 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T09:41:34.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:34.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:34.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:34.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T09:41:35.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T09:41:35.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T09:41:35.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T09:41:35.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.321 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.442 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T09:41:35.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T09:41:35.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T09:41:35.570 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-25T09:41:35.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-25T09:41:35.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T09:41:35.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-25T09:41:35.731 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-25T09:41:35.763 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T09:41:35.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-25T09:41:35.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-25T09:41:35.961 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T09:41:36.061 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-25T09:41:36.090 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:36.092 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T09:41:36.151 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-25T09:41:36.152 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-25T09:41:36.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-25T09:41:36.155 INFO:tasks.ceph.mon.a:Started 2023-08-25T09:41:36.155 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-25T09:41:36.156 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-25T09:41:36.193 INFO:tasks.ceph.mon.b:Started 2023-08-25T09:41:36.194 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-25T09:41:36.194 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-25T09:41:36.196 INFO:tasks.ceph.mon.c:Started 2023-08-25T09:41:36.197 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-25T09:41:36.197 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-25T09:41:36.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-25T09:41:36.201 INFO:tasks.ceph.mgr.y:Started 2023-08-25T09:41:36.201 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-25T09:41:36.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-25T09:41:36.204 INFO:tasks.ceph.mgr.x:Started 2023-08-25T09:41:36.205 INFO:tasks.ceph:Setting crush tunables to default 2023-08-25T09:41:36.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2023-08-25T09:41:36.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.304+0000 7f0e5b23f640 1 Processor -- start 2023-08-25T09:41:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.304+0000 7f0e5b23f640 1 -- start start 2023-08-25T09:41:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.304+0000 7f0e5b23f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 0x7f0e54156a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.304+0000 7f0e5b23f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5406b070 con 0x7f0e5406f180 2023-08-25T09:41:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.304+0000 7f0e5b23f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5406c7f0 con 0x7f0e5414b180 2023-08-25T09:41:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.304+0000 7f0e5b23f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5414aa70 con 0x7f0e5414b5e0 2023-08-25T09:41:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e58fdb640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0e5406f180 0x7f0e5406a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47672/0 (socket says 172.21.15.89:47672) 2023-08-25T09:41:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e58fdb640 1 -- 172.21.15.89:0/2978657428 learned_addr learned my addr 172.21.15.89:0/2978657428 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e597dc640 1 --2- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 0x7f0e54156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e597dc640 1 -- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 msgr2=0x7f0e54156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-25T09:41:36.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e597dc640 1 -- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 msgr2=0x7f0e54156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T09:41:36.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e597dc640 1 --2- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 0x7f0e54156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T09:41:36.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.305+0000 7f0e597dc640 1 --2- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 0x7f0e54156a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T09:41:36.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428608317 0 0) 0x7f0e5406b070 con 0x7f0e5406f180 2023-08-25T09:41:36.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e44003520 con 0x7f0e5406f180 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994347139 0 0) 0x7f0e5406c7f0 con 0x7f0e5414b180 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5406b070 con 0x7f0e5414b180 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710529003 0 0) 0x7f0e5406b070 con 0x7f0e5414b180 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 msgr2=0x7f0e54156a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 --2- 172.21.15.89:0/2978657428 >> v2:172.21.15.89:3300/0 conn(0x7f0e5414b5e0 0x7f0e54156a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 >> v1:172.21.15.89:6789/0 conn(0x7f0e5406f180 legacy=0x7f0e5406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5406c230 con 0x7f0e5414b180 2023-08-25T09:41:36.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.1 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f0e40001670 con 0x7f0e5414b180 2023-08-25T09:41:36.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 >> v1:172.21.15.121:6789/0 conn(0x7f0e5414b180 legacy=0x7f0e54153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:36.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e44003b00 0x7f0e44003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e44005180 0x7f0e4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400bfd0 con 0x7f0e440047c0 2023-08-25T09:41:36.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4400c140 con 0x7f0e44005180 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.500+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44014b10 con 0x7f0e44003b00 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e53fff640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e597dc640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e44005180 0x7f0e4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e58fdb640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e44003b00 0x7f0e44003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e53fff640 1 -- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e44003b00 msgr2=0x7f0e44003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e53fff640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e44003b00 0x7f0e44003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e53fff640 1 -- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e44005180 msgr2=0x7f0e4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e53fff640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e44005180 0x7f0e4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e597dc640 1 -- 172.21.15.89:0/2978657428 reap_dead start 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e53fff640 1 -- 172.21.15.89:0/2978657428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5406b070 con 0x7f0e440047c0 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.501+0000 7f0e58fdb640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e44003b00 0x7f0e44003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.502+0000 7f0e53fff640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e44004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e40007f50 tx=0x7f0e440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80daf5ab4b30b4a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.502+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4002c900 con 0x7f0e440047c0 2023-08-25T09:41:36.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.502+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4002ca60 con 0x7f0e440047c0 2023-08-25T09:41:36.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.502+0000 7f0e537fe640 1 -- 172.21.15.89:0/2978657428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4002ce10 con 0x7f0e440047c0 2023-08-25T09:41:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 -- 172.21.15.89:0/2978657428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 msgr2=0x7f0e44004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e44004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e40007f50 tx=0x7f0e440057f0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 -- 172.21.15.89:0/2978657428 shutdown_connections 2023-08-25T09:41:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 --2- 172.21.15.89:0/2978657428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e44004c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 -- 172.21.15.89:0/2978657428 >> 172.21.15.89:0/2978657428 conn(0x7f0e540babd0 msgr2=0x7f0e540bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 -- 172.21.15.89:0/2978657428 shutdown_connections 2023-08-25T09:41:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.503+0000 7f0e5b23f640 1 -- 172.21.15.89:0/2978657428 wait complete. 2023-08-25T09:41:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.504+0000 7f0e5b23f640 1 Processor -- start 2023-08-25T09:41:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.505+0000 7f0e5b23f640 1 -- start start 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e5b23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e5414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e5b23f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e5414d710 0x7f0e541db750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e5b23f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e541dbc90 0x7f0e54141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e5b23f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5414c900 con 0x7f0e440047c0 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e5b23f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5414dc30 con 0x7f0e541dbc90 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e5b23f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541dc110 con 0x7f0e5414d710 2023-08-25T09:41:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e5414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e5414c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41790/0 (socket says 172.21.15.89:41790) 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 -- 172.21.15.89:0/1079934815 learned_addr learned my addr 172.21.15.89:0/1079934815 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e53fff640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e5414d710 0x7f0e541db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e597dc640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e541dbc90 0x7f0e54141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 -- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e5414d710 msgr2=0x7f0e541db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e5414d710 0x7f0e541db750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 -- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e541dbc90 msgr2=0x7f0e54141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e541dbc90 0x7f0e54141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 -- 172.21.15.89:0/1079934815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5414de80 con 0x7f0e440047c0 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.506+0000 7f0e58fdb640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e5414c3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e480077c0 tx=0x7f0e480017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.507+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48005240 con 0x7f0e440047c0 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.507+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e480053a0 con 0x7f0e440047c0 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.507+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5414e160 con 0x7f0e440047c0 2023-08-25T09:41:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.507+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480047e0 con 0x7f0e440047c0 2023-08-25T09:41:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.508+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5414e440 con 0x7f0e440047c0 2023-08-25T09:41:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.508+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e48004c40 con 0x7f0e440047c0 2023-08-25T09:41:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.508+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0e48014770 con 0x7f0e440047c0 2023-08-25T09:41:36.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.508+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5404dc40 con 0x7f0e440047c0 2023-08-25T09:41:36.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.511+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0e48019070 con 0x7f0e440047c0 2023-08-25T09:41:36.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.623+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0e541db4b0 con 0x7f0e440047c0 2023-08-25T09:41:36.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.626+0000 7f0e517fa640 1 -- 172.21.15.89:0/1079934815 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0e48014980 con 0x7f0e440047c0 2023-08-25T09:41:36.627 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2023-08-25T09:41:36.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 msgr2=0x7f0e5414c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:36.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e5414c3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e480077c0 tx=0x7f0e480017e0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 shutdown_connections 2023-08-25T09:41:36.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e541dbc90 0x7f0e54141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e5414d710 0x7f0e541db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 --2- 172.21.15.89:0/1079934815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e440047c0 0x7f0e5414c3c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:36.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 >> 172.21.15.89:0/1079934815 conn(0x7f0e540babd0 msgr2=0x7f0e540b9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:36.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 shutdown_connections 2023-08-25T09:41:36.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:36.627+0000 7f0e5b23f640 1 -- 172.21.15.89:0/1079934815 wait complete. 2023-08-25T09:41:36.641 INFO:tasks.ceph:check_enable_crimson: False 2023-08-25T09:41:36.642 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-25T09:41:36.642 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:36.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-25T09:41:36.643 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:36.638+0000 7f301bc26040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T09:41:36.670 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:36.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-25T09:41:36.686 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:36.685+0000 7fda8a047040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T09:41:36.713 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:36.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-25T09:41:36.780 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-08-25T09:41:36.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-25T09:41:36.847 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:36.847 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-25T09:41:36.874 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:36.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-25T09:41:36.941 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:36.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-25T09:41:37.009 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-08-25T09:41:37.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-25T09:41:37.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 58912273-0517-4f3b-8e17-feddfa2cac01 0 2023-08-25T09:41:37.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.214+0000 7f4b3e9c4640 1 Processor -- start 2023-08-25T09:41:37.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.214+0000 7f4b3e9c4640 1 -- start start 2023-08-25T09:41:37.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b3e9c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4b38142bd0 0x7f4b3806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b3e9c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b38142fb0 con 0x7f4b3814c7b0 2023-08-25T09:41:37.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b3e9c4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3806f0e0 con 0x7f4b3806dd00 2023-08-25T09:41:37.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b3e9c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3806e840 con 0x7f4b38142bd0 2023-08-25T09:41:37.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b377fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4b3806dd00 0x7f4b3814c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56658/0 (socket says 172.21.15.121:56658) 2023-08-25T09:41:37.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b377fe640 1 -- 172.21.15.121:0/1863620593 learned_addr learned my addr 172.21.15.121:0/1863620593 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-25T09:41:37.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b37fff640 1 --2- 172.21.15.121:0/1863620593 >> v2:172.21.15.89:3300/0 conn(0x7f4b38142bd0 0x7f4b3806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698296164 0 0) 0x7f4b28001110 con 0x7f4b3806dd00 2023-08-25T09:41:37.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b20003520 con 0x7f4b3806dd00 2023-08-25T09:41:37.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777031735 0 0) 0x7f4b30001490 con 0x7f4b3814c7b0 2023-08-25T09:41:37.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b28001110 con 0x7f4b3814c7b0 2023-08-25T09:41:37.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b37fff640 1 -- 172.21.15.121:0/1863620593 >> v1:172.21.15.121:6789/0 conn(0x7f4b3806dd00 legacy=0x7f4b3814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190680089 0 0) 0x7f4b20003520 con 0x7f4b3806dd00 2023-08-25T09:41:37.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b37fff640 1 -- 172.21.15.121:0/1863620593 >> v1:172.21.15.89:6789/0 conn(0x7f4b3814c7b0 legacy=0x7f4b38153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.215+0000 7f4b37fff640 1 -- 172.21.15.121:0/1863620593 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3806eb20 con 0x7f4b38142bd0 2023-08-25T09:41:37.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.216+0000 7f4b37fff640 1 --2- 172.21.15.121:0/1863620593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b38142bd0 0x7f4b3806d1f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009720 tx=0x7f4b2c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f18dd0216619cf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.216+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28001800 con 0x7f4b38142bd0 2023-08-25T09:41:37.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.216+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c0315c0 con 0x7f4b38142bd0 2023-08-25T09:41:37.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.216+0000 7f4b36ffd640 1 -- 172.21.15.121:0/1863620593 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c031950 con 0x7f4b38142bd0 2023-08-25T09:41:37.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/1863620593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b38142bd0 msgr2=0x7f4b3806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 --2- 172.21.15.121:0/1863620593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b38142bd0 0x7f4b3806d1f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009720 tx=0x7f4b2c02b860 comp rx=0 tx=0).stop 2023-08-25T09:41:37.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/1863620593 shutdown_connections 2023-08-25T09:41:37.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 --2- 172.21.15.121:0/1863620593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b38142bd0 0x7f4b3806d1f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/1863620593 >> 172.21.15.121:0/1863620593 conn(0x7f4b380babd0 msgr2=0x7f4b380bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/1863620593 shutdown_connections 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.217+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/1863620593 wait complete. 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.218+0000 7f4b3e9c4640 1 Processor -- start 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.218+0000 7f4b3e9c4640 1 -- start start 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3e9c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b3806dd00 0x7f4b3813be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3e9c4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 0x7f4b380a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3e9c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b3814c7b0 0x7f4b38139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3e9c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380a3110 con 0x7f4b3806dd00 2023-08-25T09:41:37.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3e9c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3813c340 con 0x7f4b3814c7b0 2023-08-25T09:41:37.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3e9c4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b380a2d90 con 0x7f4b38142bd0 2023-08-25T09:41:37.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 0x7f4b380a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3cf61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b3814c7b0 0x7f4b38139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 0x7f4b380a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33460/0 (socket says 172.21.15.121:33460) 2023-08-25T09:41:37.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 -- 172.21.15.121:0/143904304 learned_addr learned my addr 172.21.15.121:0/143904304 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:37.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b37fff640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b3806dd00 0x7f4b3813be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 -- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b3814c7b0 msgr2=0x7f4b38139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b3814c7b0 0x7f4b38139840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 -- 172.21.15.121:0/143904304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b3806dd00 msgr2=0x7f4b3813be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b3806dd00 0x7f4b3813be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 -- 172.21.15.121:0/143904304 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009400 con 0x7f4b38142bd0 2023-08-25T09:41:37.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b3cf61640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b3814c7b0 0x7f4b38139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:37.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.219+0000 7f4b377fe640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 0x7f4b380a1b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c8c0 tx=0x7f4b2800cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280074e0 con 0x7f4b38142bd0 2023-08-25T09:41:37.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28007660 con 0x7f4b38142bd0 2023-08-25T09:41:37.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3806a960 con 0x7f4b38142bd0 2023-08-25T09:41:37.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28004a20 con 0x7f4b38142bd0 2023-08-25T09:41:37.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b380a20c0 con 0x7f4b38142bd0 2023-08-25T09:41:37.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b2800a5e0 con 0x7f4b38142bd0 2023-08-25T09:41:37.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.220+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4b2801d960 con 0x7f4b38142bd0 2023-08-25T09:41:37.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.221+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3804dc40 con 0x7f4b38142bd0 2023-08-25T09:41:37.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.224+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4b28018070 con 0x7f4b38142bd0 2023-08-25T09:41:37.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.296+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58912273-0517-4f3b-8e17-feddfa2cac01", "id": 0} v 0) v1 -- 0x7f4b380a2390 con 0x7f4b38142bd0 2023-08-25T09:41:37.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.299+0000 7f4b34ff9640 1 -- 172.21.15.121:0/143904304 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58912273-0517-4f3b-8e17-feddfa2cac01", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b3806f0e0 con 0x7f4b38142bd0 2023-08-25T09:41:37.301 INFO:teuthology.orchestra.run.smithi121.stdout:0 2023-08-25T09:41:37.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 msgr2=0x7f4b380a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 0x7f4b380a1b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c8c0 tx=0x7f4b2800cd80 comp rx=0 tx=0).stop 2023-08-25T09:41:37.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 shutdown_connections 2023-08-25T09:41:37.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b3814c7b0 0x7f4b38139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b38142bd0 0x7f4b380a1b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 --2- 172.21.15.121:0/143904304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b3806dd00 0x7f4b3813be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 >> 172.21.15.121:0/143904304 conn(0x7f4b380babd0 msgr2=0x7f4b380b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 shutdown_connections 2023-08-25T09:41:37.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.300+0000 7f4b3e9c4640 1 -- 172.21.15.121:0/143904304 wait complete. 2023-08-25T09:41:37.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 6287559b-ae1f-4a34-a40e-f8b9f77c862c 1 2023-08-25T09:41:37.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.413+0000 7fcf2edab640 1 Processor -- start 2023-08-25T09:41:37.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.413+0000 7fcf2edab640 1 -- start start 2023-08-25T09:41:37.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2edab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf28142bd0 0x7fcf2806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2edab640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcf2806dd00 0x7fcf2814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2edab640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf28142fb0 con 0x7fcf2806e160 2023-08-25T09:41:37.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2edab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2806f0e0 con 0x7fcf28142bd0 2023-08-25T09:41:37.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2edab640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2806e840 con 0x7fcf2806dd00 2023-08-25T09:41:37.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf27fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcf2806dd00 0x7fcf2814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2d348640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcf2806e160 0x7fcf28148790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56664/0 (socket says 172.21.15.121:56664) 2023-08-25T09:41:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2d348640 1 -- 172.21.15.121:0/2103866462 learned_addr learned my addr 172.21.15.121:0/2103866462 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-25T09:41:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf2cb47640 1 --2- 172.21.15.121:0/2103866462 >> v2:172.21.15.89:3300/0 conn(0x7fcf28142bd0 0x7fcf2806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf27fff640 1 -- 172.21.15.121:0/2103866462 >> v2:172.21.15.89:3300/0 conn(0x7fcf28142bd0 msgr2=0x7fcf2806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf27fff640 1 --2- 172.21.15.121:0/2103866462 >> v2:172.21.15.89:3300/0 conn(0x7fcf28142bd0 0x7fcf2806d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf27fff640 1 -- 172.21.15.121:0/2103866462 >> v1:172.21.15.121:6789/0 conn(0x7fcf2806e160 legacy=0x7fcf28148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf27fff640 1 -- 172.21.15.121:0/2103866462 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2806eb20 con 0x7fcf2806dd00 2023-08-25T09:41:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.414+0000 7fcf277fe640 1 -- 172.21.15.121:0/2103866462 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808434444 0 0) 0x7fcf20001490 con 0x7fcf2806e160 2023-08-25T09:41:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.415+0000 7fcf27fff640 1 --2- 172.21.15.121:0/2103866462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf2814c0a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcf2804e450 tx=0x7fcf1402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94469840fc7d762 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.415+0000 7fcf277fe640 1 -- 172.21.15.121:0/2103866462 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14030610 con 0x7fcf2806dd00 2023-08-25T09:41:37.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.415+0000 7fcf277fe640 1 -- 172.21.15.121:0/2103866462 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14030770 con 0x7fcf2806dd00 2023-08-25T09:41:37.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.415+0000 7fcf277fe640 1 -- 172.21.15.121:0/2103866462 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14030b00 con 0x7fcf2806dd00 2023-08-25T09:41:37.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 -- 172.21.15.121:0/2103866462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 msgr2=0x7fcf2814c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2103866462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf2814c0a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcf2804e450 tx=0x7fcf1402b960 comp rx=0 tx=0).stop 2023-08-25T09:41:37.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 -- 172.21.15.121:0/2103866462 shutdown_connections 2023-08-25T09:41:37.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2103866462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf2814c0a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2103866462 >> v2:172.21.15.89:3300/0 conn(0x7fcf28142bd0 0x7fcf2806d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 -- 172.21.15.121:0/2103866462 >> 172.21.15.121:0/2103866462 conn(0x7fcf280babd0 msgr2=0x7fcf280bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 -- 172.21.15.121:0/2103866462 shutdown_connections 2023-08-25T09:41:37.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.416+0000 7fcf2edab640 1 -- 172.21.15.121:0/2103866462 wait complete. 2023-08-25T09:41:37.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.417+0000 7fcf2edab640 1 Processor -- start 2023-08-25T09:41:37.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.417+0000 7fcf2edab640 1 -- start start 2023-08-25T09:41:37.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf280bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf2806e160 0x7fcf2814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf28142bd0 0x7fcf2814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280bd830 con 0x7fcf28142bd0 2023-08-25T09:41:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281dd470 con 0x7fcf2806dd00 2023-08-25T09:41:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a2ce0 con 0x7fcf2806e160 2023-08-25T09:41:37.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf280bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf280bd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41616/0 (socket says 172.21.15.121:41616) 2023-08-25T09:41:37.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 -- 172.21.15.121:0/2022943444 learned_addr learned my addr 172.21.15.121:0/2022943444 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:37.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf27fff640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf2806e160 0x7fcf2814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2d348640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf28142bd0 0x7fcf2814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 -- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf2806e160 msgr2=0x7fcf2814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf2806e160 0x7fcf2814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 -- 172.21.15.121:0/2022943444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf28142bd0 msgr2=0x7fcf2814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf28142bd0 0x7fcf2814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 -- 172.21.15.121:0/2022943444 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009400 con 0x7fcf2806dd00 2023-08-25T09:41:37.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2d348640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf28142bd0 0x7fcf2814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:37.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2cb47640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf280bd2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00e9e0 tx=0x7fcf1c00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c009670 con 0x7fcf2806dd00 2023-08-25T09:41:37.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00c9d0 con 0x7fcf2806dd00 2023-08-25T09:41:37.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00cd80 con 0x7fcf2806dd00 2023-08-25T09:41:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.418+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280b3f60 con 0x7fcf2806dd00 2023-08-25T09:41:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.419+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2814baa0 con 0x7fcf2806dd00 2023-08-25T09:41:37.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.419+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf1c005c90 con 0x7fcf2806dd00 2023-08-25T09:41:37.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.419+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcf1c013820 con 0x7fcf2806dd00 2023-08-25T09:41:37.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.419+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2804dc40 con 0x7fcf2806dd00 2023-08-25T09:41:37.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.423+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcf1c021060 con 0x7fcf2806dd00 2023-08-25T09:41:37.497 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:37.495+0000 7f301bc26040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T09:41:37.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.496+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6287559b-ae1f-4a34-a40e-f8b9f77c862c", "id": 1} v 0) v1 -- 0x7fcf2813f560 con 0x7fcf2806dd00 2023-08-25T09:41:37.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.506+0000 7fcf257fa640 1 -- 172.21.15.121:0/2022943444 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6287559b-ae1f-4a34-a40e-f8b9f77c862c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf1c017070 con 0x7fcf2806dd00 2023-08-25T09:41:37.512 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:37.503+0000 7fda8a047040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T09:41:37.512 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-08-25T09:41:37.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 msgr2=0x7fcf280bd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf280bd2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00e9e0 tx=0x7fcf1c00eea0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 shutdown_connections 2023-08-25T09:41:37.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf28142bd0 0x7fcf2814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf2806e160 0x7fcf2814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 --2- 172.21.15.121:0/2022943444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2806dd00 0x7fcf280bd2f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 >> 172.21.15.121:0/2022943444 conn(0x7fcf280babd0 msgr2=0x7fcf2813d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 shutdown_connections 2023-08-25T09:41:37.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.507+0000 7fcf2edab640 1 -- 172.21.15.121:0/2022943444 wait complete. 2023-08-25T09:41:37.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new e5bf404a-f17c-4743-a1bf-3212d9a926ba 2 2023-08-25T09:41:37.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.618+0000 7f7efeaa7640 1 Processor -- start 2023-08-25T09:41:37.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.618+0000 7f7efeaa7640 1 -- start start 2023-08-25T09:41:37.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7efeaa7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7ef806f180 0x7f7ef806a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7efeaa7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7efeaa7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef806c7f0 con 0x7f7ef814dfe0 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7efeaa7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef814aa70 con 0x7f7ef806f180 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7efeaa7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef806c230 con 0x7f7ef814b180 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef814b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33488/0 (socket says 172.21.15.121:33488) 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 -- 172.21.15.121:0/1933677080 learned_addr learned my addr 172.21.15.121:0/1933677080 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7efc843640 1 --2- 172.21.15.121:0/1933677080 >> v2:172.21.15.89:3300/0 conn(0x7f7ef806f180 0x7f7ef806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 -- 172.21.15.121:0/1933677080 >> v2:172.21.15.89:3300/0 conn(0x7f7ef806f180 msgr2=0x7f7ef806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 --2- 172.21.15.121:0/1933677080 >> v2:172.21.15.89:3300/0 conn(0x7f7ef806f180 0x7f7ef806a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 -- 172.21.15.121:0/1933677080 >> v1:172.21.15.89:6789/0 conn(0x7f7ef814dfe0 legacy=0x7f7ef814e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.619+0000 7f7ef7fff640 1 -- 172.21.15.121:0/1933677080 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef806c510 con 0x7f7ef814b180 2023-08-25T09:41:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.620+0000 7f7ef7fff640 1 --2- 172.21.15.121:0/1933677080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef814b5e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a3339f9098d695 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.620+0000 7f7ef77fe640 1 -- 172.21.15.121:0/1933677080 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee402f840 con 0x7f7ef814b180 2023-08-25T09:41:37.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.620+0000 7f7ef77fe640 1 -- 172.21.15.121:0/1933677080 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee402f9a0 con 0x7f7ef814b180 2023-08-25T09:41:37.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.620+0000 7f7ef77fe640 1 -- 172.21.15.121:0/1933677080 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee402fd30 con 0x7f7ef814b180 2023-08-25T09:41:37.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 -- 172.21.15.121:0/1933677080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 msgr2=0x7f7ef814b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/1933677080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef814b5e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee402ba20 comp rx=0 tx=0).stop 2023-08-25T09:41:37.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 -- 172.21.15.121:0/1933677080 shutdown_connections 2023-08-25T09:41:37.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/1933677080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef814b5e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/1933677080 >> v2:172.21.15.89:3300/0 conn(0x7f7ef806f180 0x7f7ef806a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 -- 172.21.15.121:0/1933677080 >> 172.21.15.121:0/1933677080 conn(0x7f7ef80babd0 msgr2=0x7f7ef80bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 -- 172.21.15.121:0/1933677080 shutdown_connections 2023-08-25T09:41:37.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.621+0000 7f7efeaa7640 1 -- 172.21.15.121:0/1933677080 wait complete. 2023-08-25T09:41:37.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.622+0000 7f7efeaa7640 1 Processor -- start 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.622+0000 7f7efeaa7640 1 -- start start 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efeaa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ef806f180 0x7f7ef80bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efeaa7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef8140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efeaa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ef814dfe0 0x7f7ef813fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efeaa7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80bd830 con 0x7f7ef814dfe0 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efeaa7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef814d590 con 0x7f7ef806f180 2023-08-25T09:41:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efeaa7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef814cc60 con 0x7f7ef814b180 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef8140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efc843640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ef806f180 0x7f7ef80bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef8140ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33500/0 (socket says 172.21.15.121:33500) 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 -- 172.21.15.121:0/3314298279 learned_addr learned my addr 172.21.15.121:0/3314298279 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efc843640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ef806f180 0x7f7ef80bd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41624/0 (socket says 172.21.15.121:41624) 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7efd044640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ef814dfe0 0x7f7ef813fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 -- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ef806f180 msgr2=0x7f7ef80bd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ef806f180 0x7f7ef80bd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 -- 172.21.15.121:0/3314298279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ef814dfe0 msgr2=0x7f7ef813fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ef814dfe0 0x7f7ef813fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 -- 172.21.15.121:0/3314298279 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40094d0 con 0x7f7ef814b180 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef7fff640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef8140ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ee402ba60 tx=0x7f7ee4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.623+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4037c40 con 0x7f7ef814b180 2023-08-25T09:41:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.624+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4037da0 con 0x7f7ef814b180 2023-08-25T09:41:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.624+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40426c0 con 0x7f7ef814b180 2023-08-25T09:41:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.624+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef814cf40 con 0x7f7ef814b180 2023-08-25T09:41:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.624+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef814d2d0 con 0x7f7ef814b180 2023-08-25T09:41:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.624+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ee4042b20 con 0x7f7ef814b180 2023-08-25T09:41:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.624+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7ee403c070 con 0x7f7ef814b180 2023-08-25T09:41:37.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.625+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef814d700 con 0x7f7ef814b180 2023-08-25T09:41:37.632 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.628+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7ee4047070 con 0x7f7ef814b180 2023-08-25T09:41:37.643 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:37.642+0000 7fda8a047040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T09:41:37.645 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:37.644+0000 7f301bc26040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T09:41:37.692 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:37.690+0000 7fda8a047040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T09:41:37.695 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:37.694+0000 7f301bc26040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T09:41:37.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.700+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5bf404a-f17c-4743-a1bf-3212d9a926ba", "id": 2} v 0) v1 -- 0x7f7ef804dc40 con 0x7f7ef814b180 2023-08-25T09:41:37.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.707+0000 7f7ef57fa640 1 -- 172.21.15.121:0/3314298279 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5bf404a-f17c-4743-a1bf-3212d9a926ba", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ee404b3f0 con 0x7f7ef814b180 2023-08-25T09:41:37.709 INFO:teuthology.orchestra.run.smithi121.stdout:2 2023-08-25T09:41:37.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 msgr2=0x7f7ef8140ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef8140ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ee402ba60 tx=0x7f7ee4004730 comp rx=0 tx=0).stop 2023-08-25T09:41:37.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 shutdown_connections 2023-08-25T09:41:37.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ef814dfe0 0x7f7ef813fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ef814b180 0x7f7ef8140ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 --2- 172.21.15.121:0/3314298279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ef806f180 0x7f7ef80bd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 >> 172.21.15.121:0/3314298279 conn(0x7f7ef80babd0 msgr2=0x7f7ef814e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 shutdown_connections 2023-08-25T09:41:37.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.708+0000 7f7efeaa7640 1 -- 172.21.15.121:0/3314298279 wait complete. 2023-08-25T09:41:37.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new be91dfff-ca51-4056-a5be-650059303ff2 3 2023-08-25T09:41:37.736 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:37.735+0000 7fda8a047040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T09:41:37.744 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:37.741+0000 7f301bc26040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T09:41:37.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 Processor -- start 2023-08-25T09:41:37.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 -- start start 2023-08-25T09:41:37.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f40cc06abd0 0x7f40cc147640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40cc141be0 0x7f40cc0b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc147f60 con 0x7f40cc0b3df0 2023-08-25T09:41:37.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0b7ab0 con 0x7f40cc141be0 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.820+0000 7f40d1bf3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc148240 con 0x7f40cc06abd0 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cb7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f40cc06abd0 0x7f40cc147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40caffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f40cc0b3df0 0x7f40cc1414d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56668/0 (socket says 172.21.15.121:56668) 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cb7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f40cc06abd0 0x7f40cc147640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41626/0 (socket says 172.21.15.121:41626) 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40caffd640 1 -- 172.21.15.121:0/764507552 learned_addr learned my addr 172.21.15.121:0/764507552 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cbfff640 1 --2- 172.21.15.121:0/764507552 >> v2:172.21.15.89:3300/0 conn(0x7f40cc141be0 0x7f40cc0b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cb7fe640 1 -- 172.21.15.121:0/764507552 >> v2:172.21.15.89:3300/0 conn(0x7f40cc141be0 msgr2=0x7f40cc0b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cb7fe640 1 --2- 172.21.15.121:0/764507552 >> v2:172.21.15.89:3300/0 conn(0x7f40cc141be0 0x7f40cc0b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cb7fe640 1 -- 172.21.15.121:0/764507552 >> v1:172.21.15.121:6789/0 conn(0x7f40cc0b3df0 legacy=0x7f40cc1414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40ca7fc640 1 -- 172.21.15.121:0/764507552 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172756836 0 0) 0x7f40cc147f60 con 0x7f40cc0b3df0 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.821+0000 7f40cb7fe640 1 -- 172.21.15.121:0/764507552 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc148520 con 0x7f40cc06abd0 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40cb7fe640 1 --2- 172.21.15.121:0/764507552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc06abd0 0x7f40cc147640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40cc071a40 tx=0x7f40bc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31003297c3f31d80 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40ca7fc640 1 -- 172.21.15.121:0/764507552 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc030610 con 0x7f40cc06abd0 2023-08-25T09:41:37.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40ca7fc640 1 -- 172.21.15.121:0/764507552 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc030770 con 0x7f40cc06abd0 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40ca7fc640 1 -- 172.21.15.121:0/764507552 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc030b00 con 0x7f40cc06abd0 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40d1bf3640 1 -- 172.21.15.121:0/764507552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc06abd0 msgr2=0x7f40cc147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/764507552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc06abd0 0x7f40cc147640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40cc071a40 tx=0x7f40bc02b960 comp rx=0 tx=0).stop 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40d1bf3640 1 -- 172.21.15.121:0/764507552 shutdown_connections 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/764507552 >> v2:172.21.15.89:3300/0 conn(0x7f40cc141be0 0x7f40cc0b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/764507552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc06abd0 0x7f40cc147640 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.822+0000 7f40d1bf3640 1 -- 172.21.15.121:0/764507552 >> 172.21.15.121:0/764507552 conn(0x7f40cc0b9a80 msgr2=0x7f40cc0b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.823+0000 7f40d1bf3640 1 -- 172.21.15.121:0/764507552 shutdown_connections 2023-08-25T09:41:37.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.823+0000 7f40d1bf3640 1 -- 172.21.15.121:0/764507552 wait complete. 2023-08-25T09:41:37.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 Processor -- start 2023-08-25T09:41:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 -- start start 2023-08-25T09:41:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 0x7f40cc1d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc0b3df0 0x7f40cc1cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc141be0 0x7f40cc13c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1d22f0 con 0x7f40cc0b3df0 2023-08-25T09:41:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1d04d0 con 0x7f40cc141be0 2023-08-25T09:41:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40d1bf3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1ce660 con 0x7f40cc06abd0 2023-08-25T09:41:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 0x7f40cc1d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 0x7f40cc1d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33510/0 (socket says 172.21.15.121:33510) 2023-08-25T09:41:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40cb7fe640 1 -- 172.21.15.121:0/1370707628 learned_addr learned my addr 172.21.15.121:0/1370707628 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.824+0000 7f40cbfff640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc141be0 0x7f40cc13c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40caffd640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc0b3df0 0x7f40cc1cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cb7fe640 1 -- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc141be0 msgr2=0x7f40cc13c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cb7fe640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc141be0 0x7f40cc13c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cb7fe640 1 -- 172.21.15.121:0/1370707628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc0b3df0 msgr2=0x7f40cc1cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cb7fe640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc0b3df0 0x7f40cc1cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cb7fe640 1 -- 172.21.15.121:0/1370707628 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009400 con 0x7f40cc06abd0 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40caffd640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc0b3df0 0x7f40cc1cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cbfff640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc141be0 0x7f40cc13c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40cb7fe640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 0x7f40cc1d1db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40bc009890 tx=0x7f40bc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc03e040 con 0x7f40cc06abd0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc039c90 con 0x7f40cc06abd0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc1cfcc0 con 0x7f40cc06abd0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc030e10 con 0x7f40cc06abd0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc1ceb80 con 0x7f40cc06abd0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f40bc04e740 con 0x7f40cc06abd0 2023-08-25T09:41:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.825+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f40bc044ba0 con 0x7f40cc06abd0 2023-08-25T09:41:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.826+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc1ce4a0 con 0x7f40cc06abd0 2023-08-25T09:41:37.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.830+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f40bc049070 con 0x7f40cc06abd0 2023-08-25T09:41:37.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.901+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be91dfff-ca51-4056-a5be-650059303ff2", "id": 3} v 0) v1 -- 0x7f40cc1d02c0 con 0x7f40cc06abd0 2023-08-25T09:41:37.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.907+0000 7f40b3fff640 1 -- 172.21.15.121:0/1370707628 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be91dfff-ca51-4056-a5be-650059303ff2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f40bc034070 con 0x7f40cc06abd0 2023-08-25T09:41:37.909 INFO:teuthology.orchestra.run.smithi121.stdout:3 2023-08-25T09:41:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 msgr2=0x7f40cc1d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 0x7f40cc1d1db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40bc009890 tx=0x7f40bc004730 comp rx=0 tx=0).stop 2023-08-25T09:41:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 shutdown_connections 2023-08-25T09:41:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40cc0b3df0 0x7f40cc1cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc141be0 0x7f40cc13c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 --2- 172.21.15.121:0/1370707628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc06abd0 0x7f40cc1d1db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 >> 172.21.15.121:0/1370707628 conn(0x7f40cc0b9a80 msgr2=0x7f40cc13fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 shutdown_connections 2023-08-25T09:41:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:37.908+0000 7f40d1bf3640 1 -- 172.21.15.121:0/1370707628 wait complete. 2023-08-25T09:41:37.919 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 1bdde289-aee9-42f9-8be8-22af818ccd3d 4 2023-08-25T09:41:38.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.057+0000 7f497d107640 1 Processor -- start 2023-08-25T09:41:38.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.057+0000 7f497d107640 1 -- start start 2023-08-25T09:41:38.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.057+0000 7f497d107640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4978070620 0x7f4978148940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.057+0000 7f497d107640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49780b4160 con 0x7f49780b6900 2023-08-25T09:41:38.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.057+0000 7f497d107640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49780712c0 con 0x7f4978142c80 2023-08-25T09:41:38.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.057+0000 7f497d107640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4978070060 con 0x7f4978070620 2023-08-25T09:41:38.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f497759e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4978142c80 0x7f4978153090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56672/0 (socket says 172.21.15.121:56672) 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f497759e640 1 -- 172.21.15.121:0/4199729516 learned_addr learned my addr 172.21.15.121:0/4199729516 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f496ffff640 1 --2- 172.21.15.121:0/4199729516 >> v2:172.21.15.89:3300/0 conn(0x7f4978070620 0x7f4978148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f497659c640 1 -- 172.21.15.121:0/4199729516 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022621157 0 0) 0x7f49780712c0 con 0x7f4978142c80 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f497659c640 1 -- 172.21.15.121:0/4199729516 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4964003520 con 0x7f4978142c80 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f496ffff640 1 -- 172.21.15.121:0/4199729516 >> v1:172.21.15.121:6789/0 conn(0x7f4978142c80 legacy=0x7f4978153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f496ffff640 1 -- 172.21.15.121:0/4199729516 >> v1:172.21.15.89:6789/0 conn(0x7f49780b6900 legacy=0x7f4978142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f497659c640 1 -- 172.21.15.121:0/4199729516 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342801433 0 0) 0x7f4968001110 con 0x7f49780b6900 2023-08-25T09:41:38.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.058+0000 7f496ffff640 1 -- 172.21.15.121:0/4199729516 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978070c70 con 0x7f4978070620 2023-08-25T09:41:38.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.059+0000 7f496ffff640 1 --2- 172.21.15.121:0/4199729516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978070620 0x7f4978148940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f49600097a0 tx=0x7f496002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e012b66a58e5c55 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.059+0000 7f497659c640 1 -- 172.21.15.121:0/4199729516 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496002f810 con 0x7f4978070620 2023-08-25T09:41:38.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.059+0000 7f497659c640 1 -- 172.21.15.121:0/4199729516 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496002f970 con 0x7f4978070620 2023-08-25T09:41:38.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.059+0000 7f497659c640 1 -- 172.21.15.121:0/4199729516 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496002fce0 con 0x7f4978070620 2023-08-25T09:41:38.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 -- 172.21.15.121:0/4199729516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978070620 msgr2=0x7f4978148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 --2- 172.21.15.121:0/4199729516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978070620 0x7f4978148940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f49600097a0 tx=0x7f496002b9f0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 -- 172.21.15.121:0/4199729516 shutdown_connections 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 --2- 172.21.15.121:0/4199729516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978070620 0x7f4978148940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 -- 172.21.15.121:0/4199729516 >> 172.21.15.121:0/4199729516 conn(0x7f49780b9a80 msgr2=0x7f49780b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 -- 172.21.15.121:0/4199729516 shutdown_connections 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.060+0000 7f497d107640 1 -- 172.21.15.121:0/4199729516 wait complete. 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 Processor -- start 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 -- start start 2023-08-25T09:41:38.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 0x7f49781430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 0x7f4978144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978142c80 0x7f49780b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b7e20 con 0x7f4978142c80 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49781dd210 con 0x7f49780b6900 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.061+0000 7f497d107640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4978144e60 con 0x7f4978070620 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 0x7f49781430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 0x7f4978144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 0x7f49781430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33512/0 (socket says 172.21.15.121:33512) 2023-08-25T09:41:38.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 0x7f4978144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41644/0 (socket says 172.21.15.121:41644) 2023-08-25T09:41:38.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 -- 172.21.15.121:0/1626745524 learned_addr learned my addr 172.21.15.121:0/1626745524 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:38.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f497759e640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978142c80 0x7f49780b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 -- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 msgr2=0x7f4978144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 0x7f4978144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 -- 172.21.15.121:0/1626745524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978142c80 msgr2=0x7f49780b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978142c80 0x7f49780b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 -- 172.21.15.121:0/1626745524 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009400 con 0x7f4978070620 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f497759e640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978142c80 0x7f49780b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496ffff640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 0x7f4978144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f4976d9d640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 0x7f49781430f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f496800c750 tx=0x7f496800cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968005270 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49680053f0 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800a880 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49781436d0 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4978143c90 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f496800ace0 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.062+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4968003d70 con 0x7f4978070620 2023-08-25T09:41:38.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.063+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497804dc40 con 0x7f4978070620 2023-08-25T09:41:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.067+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4968017070 con 0x7f4978070620 2023-08-25T09:41:38.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.139+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1bdde289-aee9-42f9-8be8-22af818ccd3d", "id": 4} v 0) v1 -- 0x7f497806b0b0 con 0x7f4978070620 2023-08-25T09:41:38.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.144+0000 7f496f7fe640 1 -- 172.21.15.121:0/1626745524 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bdde289-aee9-42f9-8be8-22af818ccd3d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f49780b4160 con 0x7f4978070620 2023-08-25T09:41:38.146 INFO:teuthology.orchestra.run.smithi121.stdout:4 2023-08-25T09:41:38.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 msgr2=0x7f49781430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 0x7f49781430f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f496800c750 tx=0x7f496800cc10 comp rx=0 tx=0).stop 2023-08-25T09:41:38.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 shutdown_connections 2023-08-25T09:41:38.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4978142c80 0x7f49780b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49780b6900 0x7f4978144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 --2- 172.21.15.121:0/1626745524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4978070620 0x7f49781430f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 >> 172.21.15.121:0/1626745524 conn(0x7f49780b9a80 msgr2=0x7f4978147720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 shutdown_connections 2023-08-25T09:41:38.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.145+0000 7f497d107640 1 -- 172.21.15.121:0/1626745524 wait complete. 2023-08-25T09:41:38.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 9c927680-7454-420e-880c-cb01faeeee37 5 2023-08-25T09:41:38.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.253+0000 7fd41f0a7640 1 Processor -- start 2023-08-25T09:41:38.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.253+0000 7fd41f0a7640 1 -- start start 2023-08-25T09:41:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41f0a7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 0x7fd41806a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41f0a7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd41814b5e0 0x7fd41814e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41f0a7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41806c7f0 con 0x7fd41814b180 2023-08-25T09:41:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41f0a7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41814aa70 con 0x7fd41814b5e0 2023-08-25T09:41:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41f0a7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41806c230 con 0x7fd41806f180 2023-08-25T09:41:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41ce43640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 0x7fd41806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41ce43640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 0x7fd41806a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33516/0 (socket says 172.21.15.121:33516) 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41ce43640 1 -- 172.21.15.121:0/1193051856 learned_addr learned my addr 172.21.15.121:0/1193051856 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41d644640 1 --2- 172.21.15.121:0/1193051856 >> v2:172.21.15.89:3300/0 conn(0x7fd41814b5e0 0x7fd41814e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41ce43640 1 -- 172.21.15.121:0/1193051856 >> v2:172.21.15.89:3300/0 conn(0x7fd41814b5e0 msgr2=0x7fd41814e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.254+0000 7fd41ce43640 1 --2- 172.21.15.121:0/1193051856 >> v2:172.21.15.89:3300/0 conn(0x7fd41814b5e0 0x7fd41814e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.255+0000 7fd41ce43640 1 -- 172.21.15.121:0/1193051856 >> v1:172.21.15.89:6789/0 conn(0x7fd41814b180 legacy=0x7fd41814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.255+0000 7fd41ce43640 1 -- 172.21.15.121:0/1193051856 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41806c510 con 0x7fd41806f180 2023-08-25T09:41:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.255+0000 7fd41ce43640 1 --2- 172.21.15.121:0/1193051856 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 0x7fd41806a960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd414009870 tx=0x7fd41402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c82e61159922684 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.255+0000 7fd40f7fe640 1 -- 172.21.15.121:0/1193051856 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41402f840 con 0x7fd41806f180 2023-08-25T09:41:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.255+0000 7fd40f7fe640 1 -- 172.21.15.121:0/1193051856 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41402f9a0 con 0x7fd41806f180 2023-08-25T09:41:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.255+0000 7fd40f7fe640 1 -- 172.21.15.121:0/1193051856 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41402fd30 con 0x7fd41806f180 2023-08-25T09:41:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 -- 172.21.15.121:0/1193051856 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 msgr2=0x7fd41806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/1193051856 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 0x7fd41806a960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd414009870 tx=0x7fd41402ba20 comp rx=0 tx=0).stop 2023-08-25T09:41:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 -- 172.21.15.121:0/1193051856 shutdown_connections 2023-08-25T09:41:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/1193051856 >> v2:172.21.15.89:3300/0 conn(0x7fd41814b5e0 0x7fd41814e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/1193051856 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41806f180 0x7fd41806a960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 -- 172.21.15.121:0/1193051856 >> 172.21.15.121:0/1193051856 conn(0x7fd4180babd0 msgr2=0x7fd4180bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 -- 172.21.15.121:0/1193051856 shutdown_connections 2023-08-25T09:41:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.256+0000 7fd41f0a7640 1 -- 172.21.15.121:0/1193051856 wait complete. 2023-08-25T09:41:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.257+0000 7fd41f0a7640 1 Processor -- start 2023-08-25T09:41:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.257+0000 7fd41f0a7640 1 -- start start 2023-08-25T09:41:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41f0a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 0x7fd4181423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41f0a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd41814b180 0x7fd4181dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41f0a7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41814b5e0 0x7fd418140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41f0a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41814bdf0 con 0x7fd41814b180 2023-08-25T09:41:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41f0a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd418142930 con 0x7fd41806f180 2023-08-25T09:41:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41f0a7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41814d920 con 0x7fd41814b5e0 2023-08-25T09:41:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 0x7fd4181423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41d644640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41814b5e0 0x7fd418140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 0x7fd4181423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41646/0 (socket says 172.21.15.121:41646) 2023-08-25T09:41:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 -- 172.21.15.121:0/3729328363 learned_addr learned my addr 172.21.15.121:0/3729328363 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd40ffff640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd41814b180 0x7fd4181dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 -- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41814b5e0 msgr2=0x7fd418140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41814b5e0 0x7fd418140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 -- 172.21.15.121:0/3729328363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd41814b180 msgr2=0x7fd4181dfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd41814b180 0x7fd4181dfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41ce43640 1 -- 172.21.15.121:0/3729328363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140094d0 con 0x7fd41806f180 2023-08-25T09:41:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd41d644640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41814b5e0 0x7fd418140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.258+0000 7fd40ffff640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd41814b180 0x7fd4181dfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.259+0000 7fd41ce43640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 0x7fd4181423f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd414000c00 tx=0x7fd414004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.259+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414037c40 con 0x7fd41806f180 2023-08-25T09:41:38.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.259+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd414037da0 con 0x7fd41806f180 2023-08-25T09:41:38.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.259+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414041640 con 0x7fd41806f180 2023-08-25T09:41:38.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.259+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4181e38f0 con 0x7fd41806f180 2023-08-25T09:41:38.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.260+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4181e3580 con 0x7fd41806f180 2023-08-25T09:41:38.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.260+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd414041aa0 con 0x7fd41806f180 2023-08-25T09:41:38.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.260+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd41403c070 con 0x7fd41806f180 2023-08-25T09:41:38.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.261+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41804dc40 con 0x7fd41806f180 2023-08-25T09:41:38.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.263+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd41404b460 con 0x7fd41806f180 2023-08-25T09:41:38.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.334+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c927680-7454-420e-880c-cb01faeeee37", "id": 5} v 0) v1 -- 0x7fd4180ba4f0 con 0x7fd41806f180 2023-08-25T09:41:38.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.337+0000 7fd40d7fa640 1 -- 172.21.15.121:0/3729328363 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c927680-7454-420e-880c-cb01faeeee37", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd41404b9b0 con 0x7fd41806f180 2023-08-25T09:41:38.339 INFO:teuthology.orchestra.run.smithi121.stdout:5 2023-08-25T09:41:38.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 msgr2=0x7fd4181423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 0x7fd4181423f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd414000c00 tx=0x7fd414004730 comp rx=0 tx=0).stop 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 shutdown_connections 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd41814b180 0x7fd4181dfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41814b5e0 0x7fd418140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 --2- 172.21.15.121:0/3729328363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41806f180 0x7fd4181423f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 >> 172.21.15.121:0/3729328363 conn(0x7fd4180babd0 msgr2=0x7fd418143270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.338+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 shutdown_connections 2023-08-25T09:41:38.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.339+0000 7fd41f0a7640 1 -- 172.21.15.121:0/3729328363 wait complete. 2023-08-25T09:41:38.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new fc569826-f7bf-40ee-9683-8f25d96bd17f 6 2023-08-25T09:41:38.436 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.435+0000 7fda8a047040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T09:41:38.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.448+0000 7fc3d3376640 1 Processor -- start 2023-08-25T09:41:38.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.448+0000 7fc3d3376640 1 -- start start 2023-08-25T09:41:38.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d3376640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc3cc0bcf70 0x7fc3cc0bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d3376640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc3cc144560 0x7fc3cc1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d3376640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0ba300 con 0x7fc3cc14a9a0 2023-08-25T09:41:38.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d3376640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0b9640 con 0x7fc3cc144560 2023-08-25T09:41:38.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d3376640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0bcb40 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc3cc0bcf70 0x7fc3cc0bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc3cc0bcf70 0x7fc3cc0bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41658/0 (socket says 172.21.15.121:41658) 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 -- 172.21.15.121:0/254861782 learned_addr learned my addr 172.21.15.121:0/254861782 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d0911640 1 --2- 172.21.15.121:0/254861782 >> v2:172.21.15.89:3300/0 conn(0x7fc3cc144560 0x7fc3cc1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 -- 172.21.15.121:0/254861782 >> v2:172.21.15.89:3300/0 conn(0x7fc3cc144560 msgr2=0x7fc3cc1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 --2- 172.21.15.121:0/254861782 >> v2:172.21.15.89:3300/0 conn(0x7fc3cc144560 0x7fc3cc1449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 -- 172.21.15.121:0/254861782 >> v1:172.21.15.89:6789/0 conn(0x7fc3cc14a9a0 legacy=0x7fc3cc14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.449+0000 7fc3d1112640 1 -- 172.21.15.121:0/254861782 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0bc8c0 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.450+0000 7fc3d1112640 1 --2- 172.21.15.121:0/254861782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc0bc380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0bd6b0 tx=0x7fc3c802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd2e102c619ad551 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.450+0000 7fc3c3fff640 1 -- 172.21.15.121:0/254861782 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8030860 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.450+0000 7fc3c3fff640 1 -- 172.21.15.121:0/254861782 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c80309c0 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.450+0000 7fc3c3fff640 1 -- 172.21.15.121:0/254861782 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8030d50 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 -- 172.21.15.121:0/254861782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 msgr2=0x7fc3cc0bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 --2- 172.21.15.121:0/254861782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc0bc380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0bd6b0 tx=0x7fc3c802b9a0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 -- 172.21.15.121:0/254861782 shutdown_connections 2023-08-25T09:41:38.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 --2- 172.21.15.121:0/254861782 >> v2:172.21.15.89:3300/0 conn(0x7fc3cc144560 0x7fc3cc1449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 --2- 172.21.15.121:0/254861782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc0bc380 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 -- 172.21.15.121:0/254861782 >> 172.21.15.121:0/254861782 conn(0x7fc3cc0654f0 msgr2=0x7fc3cc0658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 -- 172.21.15.121:0/254861782 shutdown_connections 2023-08-25T09:41:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.451+0000 7fc3d3376640 1 -- 172.21.15.121:0/254861782 wait complete. 2023-08-25T09:41:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.452+0000 7fc3d3376640 1 Processor -- start 2023-08-25T09:41:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.452+0000 7fc3d3376640 1 -- start start 2023-08-25T09:41:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d3376640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc1e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d3376640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3cc144560 0x7fc3cc0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d3376640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 0x7fc3cc0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d3376640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1e0120 con 0x7fc3cc144560 2023-08-25T09:41:38.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d3376640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1df830 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d3376640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1dfad0 con 0x7fc3cc14a9a0 2023-08-25T09:41:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc1e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1913640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 0x7fc3cc0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc1e2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41670/0 (socket says 172.21.15.121:41670) 2023-08-25T09:41:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1913640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 0x7fc3cc0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:33530/0 (socket says 172.21.15.121:33530) 2023-08-25T09:41:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 -- 172.21.15.121:0/408902680 learned_addr learned my addr 172.21.15.121:0/408902680 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d0911640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3cc144560 0x7fc3cc0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 -- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 msgr2=0x7fc3cc0b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 0x7fc3cc0b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 -- 172.21.15.121:0/408902680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3cc144560 msgr2=0x7fc3cc0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3cc144560 0x7fc3cc0b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 -- 172.21.15.121:0/408902680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80094d0 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1913640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 0x7fc3cc0b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3d1112640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc1e2d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc3c802b9e0 tx=0x7fc3c8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.453+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8039c90 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.454+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8039e10 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.454+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc1dfdb0 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.454+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8043640 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.454+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc14ea20 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.454+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc3c8043aa0 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.454+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc3c803e070 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.455+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc1dff40 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.457+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc3c8034070 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.490 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.488+0000 7fda8a047040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T09:41:38.524 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:38.523+0000 7f301bc26040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T09:41:38.535 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.534+0000 7fda8a047040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T09:41:38.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.548+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc569826-f7bf-40ee-9683-8f25d96bd17f", "id": 6} v 0) v1 -- 0x7fc3cc04dc40 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.552+0000 7fc3c1ffb640 1 -- 172.21.15.121:0/408902680 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc569826-f7bf-40ee-9683-8f25d96bd17f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3c804d460 con 0x7fc3cc0bcf70 2023-08-25T09:41:38.554 INFO:teuthology.orchestra.run.smithi121.stdout:6 2023-08-25T09:41:38.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 msgr2=0x7fc3cc1e2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc1e2d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc3c802b9e0 tx=0x7fc3c8004730 comp rx=0 tx=0).stop 2023-08-25T09:41:38.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 shutdown_connections 2023-08-25T09:41:38.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3cc144560 0x7fc3cc0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3cc14a9a0 0x7fc3cc0b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 --2- 172.21.15.121:0/408902680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3cc0bcf70 0x7fc3cc1e2d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 >> 172.21.15.121:0/408902680 conn(0x7fc3cc0654f0 msgr2=0x7fc3cc0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 shutdown_connections 2023-08-25T09:41:38.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.553+0000 7fc3d3376640 1 -- 172.21.15.121:0/408902680 wait complete. 2023-08-25T09:41:38.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 15cf9447-ea96-4ab0-bf40-e2522760dc37 7 2023-08-25T09:41:38.593 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:38.591+0000 7f301bc26040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T09:41:38.640 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:38.638+0000 7f301bc26040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T09:41:38.644 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.643+0000 7fda8a047040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T09:41:38.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.661+0000 7f670f4ec640 1 Processor -- start 2023-08-25T09:41:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670f4ec640 1 -- start start 2023-08-25T09:41:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670f4ec640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f67080b9b20 0x7f6708070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670f4ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6708140970 0x7f6708140e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670f4ec640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670806f140 con 0x7f670814a450 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670f4ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670806f420 con 0x7f6708140970 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670f4ec640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670806f700 con 0x7f67080b9b20 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.662+0000 7f670d288640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f67080b9b20 0x7f6708070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670da89640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f670814a450 0x7f670814a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56686/0 (socket says 172.21.15.121:56686) 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670da89640 1 -- 172.21.15.121:0/3328448050 learned_addr learned my addr 172.21.15.121:0/3328448050 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-08-25T09:41:38.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670ca87640 1 --2- 172.21.15.121:0/3328448050 >> v2:172.21.15.89:3300/0 conn(0x7f6708140970 0x7f6708140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670d288640 1 -- 172.21.15.121:0/3328448050 >> v2:172.21.15.89:3300/0 conn(0x7f6708140970 msgr2=0x7f6708140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670d288640 1 --2- 172.21.15.121:0/3328448050 >> v2:172.21.15.89:3300/0 conn(0x7f6708140970 0x7f6708140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670d288640 1 -- 172.21.15.121:0/3328448050 >> v1:172.21.15.121:6789/0 conn(0x7f670814a450 legacy=0x7f670814a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f66fffff640 1 -- 172.21.15.121:0/3328448050 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671223458 0 0) 0x7f670806f140 con 0x7f670814a450 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.663+0000 7f670d288640 1 -- 172.21.15.121:0/3328448050 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670806f9e0 con 0x7f67080b9b20 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670d288640 1 --2- 172.21.15.121:0/3328448050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67080b9b20 0x7f6708070a20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f670806acc0 tx=0x7f66f802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a765f72d93926e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f66fffff640 1 -- 172.21.15.121:0/3328448050 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8031830 con 0x7f67080b9b20 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f66fffff640 1 -- 172.21.15.121:0/3328448050 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8031990 con 0x7f67080b9b20 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f66fffff640 1 -- 172.21.15.121:0/3328448050 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8031d20 con 0x7f67080b9b20 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 -- 172.21.15.121:0/3328448050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67080b9b20 msgr2=0x7f6708070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 --2- 172.21.15.121:0/3328448050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67080b9b20 0x7f6708070a20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f670806acc0 tx=0x7f66f802b8d0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 -- 172.21.15.121:0/3328448050 shutdown_connections 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 --2- 172.21.15.121:0/3328448050 >> v2:172.21.15.89:3300/0 conn(0x7f6708140970 0x7f6708140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 --2- 172.21.15.121:0/3328448050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67080b9b20 0x7f6708070a20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 -- 172.21.15.121:0/3328448050 >> 172.21.15.121:0/3328448050 conn(0x7f67080bd370 msgr2=0x7f67080b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 -- 172.21.15.121:0/3328448050 shutdown_connections 2023-08-25T09:41:38.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.664+0000 7f670f4ec640 1 -- 172.21.15.121:0/3328448050 wait complete. 2023-08-25T09:41:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.665+0000 7f670f4ec640 1 Processor -- start 2023-08-25T09:41:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.665+0000 7f670f4ec640 1 -- start start 2023-08-25T09:41:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670f4ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67080b9b20 0x7f6708152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670f4ec640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6708140970 0x7f67081e1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670f4ec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 0x7f67081e1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670f4ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6708152d60 con 0x7f67080b9b20 2023-08-25T09:41:38.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670f4ec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6708144390 con 0x7f670814a450 2023-08-25T09:41:38.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670f4ec640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67081457e0 con 0x7f6708140970 2023-08-25T09:41:38.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670da89640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 0x7f67081e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670da89640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 0x7f67081e1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41692/0 (socket says 172.21.15.121:41692) 2023-08-25T09:41:38.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670ca87640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6708140970 0x7f67081e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670da89640 1 -- 172.21.15.121:0/2448120441 learned_addr learned my addr 172.21.15.121:0/2448120441 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-08-25T09:41:38.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670d288640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67080b9b20 0x7f6708152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670ca87640 1 -- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 msgr2=0x7f67081e1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670ca87640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 0x7f67081e1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670ca87640 1 -- 172.21.15.121:0/2448120441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67080b9b20 msgr2=0x7f6708152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670ca87640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67080b9b20 0x7f6708152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670ca87640 1 -- 172.21.15.121:0/2448120441 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8009400 con 0x7f6708140970 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.666+0000 7f670da89640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 0x7f67081e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f670ca87640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6708140970 0x7f67081e1150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f670400e840 tx=0x7f670400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704004240 con 0x7f6708140970 2023-08-25T09:41:38.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040043a0 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6708143ad0 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400c950 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6708145500 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6704003610 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.667+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f67040134c0 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.668+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67080b8650 con 0x7f6708140970 2023-08-25T09:41:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.670+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6704017020 con 0x7f6708140970 2023-08-25T09:41:38.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.741+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15cf9447-ea96-4ab0-bf40-e2522760dc37", "id": 7} v 0) v1 -- 0x7f670804dc40 con 0x7f6708140970 2023-08-25T09:41:38.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.745+0000 7f66fdffb640 1 -- 172.21.15.121:0/2448120441 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15cf9447-ea96-4ab0-bf40-e2522760dc37", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6704029020 con 0x7f6708140970 2023-08-25T09:41:38.747 INFO:teuthology.orchestra.run.smithi121.stdout:7 2023-08-25T09:41:38.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6708140970 msgr2=0x7f67081e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6708140970 0x7f67081e1150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f670400e840 tx=0x7f670400ed00 comp rx=0 tx=0).stop 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 shutdown_connections 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670814a450 0x7f67081e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6708140970 0x7f67081e1150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 --2- 172.21.15.121:0/2448120441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67080b9b20 0x7f6708152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.746+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 >> 172.21.15.121:0/2448120441 conn(0x7f67080bd370 msgr2=0x7f67080b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.747+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 shutdown_connections 2023-08-25T09:41:38.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-08-25T09:41:38.747+0000 7f670f4ec640 1 -- 172.21.15.121:0/2448120441 wait complete. 2023-08-25T09:41:38.754 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:38.753+0000 7f301bc26040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T09:41:38.758 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-25T09:41:38.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-25T09:41:38.761 INFO:tasks.ceph.osd.0:Started 2023-08-25T09:41:38.761 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-25T09:41:38.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-25T09:41:38.764 INFO:tasks.ceph.osd.1:Started 2023-08-25T09:41:38.765 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-25T09:41:38.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-25T09:41:38.767 INFO:tasks.ceph.osd.2:Started 2023-08-25T09:41:38.767 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-25T09:41:38.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-25T09:41:38.770 INFO:tasks.ceph.osd.3:Started 2023-08-25T09:41:38.770 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-25T09:41:38.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-25T09:41:38.788 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.787+0000 7fda8a047040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T09:41:38.801 INFO:tasks.ceph.osd.4:Started 2023-08-25T09:41:38.802 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-25T09:41:38.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-25T09:41:38.805 INFO:tasks.ceph.osd.5:Started 2023-08-25T09:41:38.806 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-25T09:41:38.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-25T09:41:38.810 INFO:tasks.ceph.osd.6:Started 2023-08-25T09:41:38.811 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-25T09:41:38.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-25T09:41:38.814 INFO:tasks.ceph.osd.7:Started 2023-08-25T09:41:38.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:41:38.898 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.897+0000 7fda8a047040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T09:41:38.910 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:38.909+0000 7f301bc26040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T09:41:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.927+0000 7f3018d01640 1 Processor -- start 2023-08-25T09:41:38.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.927+0000 7f3018d01640 1 -- start start 2023-08-25T09:41:38.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3018d01640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f301406abd0 0x7f30140b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3018d01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f301414aae0 0x7f301414af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3018d01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301406ff50 con 0x7f3014070320 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3018d01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30140710c0 con 0x7f301414aae0 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3018d01640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30140b4a00 con 0x7f301406abd0 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3012d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f301414aae0 0x7f301414af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3011d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3014070320 0x7f3014144890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47700/0 (socket says 172.21.15.89:47700) 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3011d9b640 1 -- 172.21.15.89:0/542173948 learned_addr learned my addr 172.21.15.89:0/542173948 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:38.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f301259c640 1 --2- 172.21.15.89:0/542173948 >> v2:172.21.15.121:3300/0 conn(0x7f301406abd0 0x7f30140b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3012d9d640 1 -- 172.21.15.89:0/542173948 >> v2:172.21.15.121:3300/0 conn(0x7f301406abd0 msgr2=0x7f30140b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3012d9d640 1 --2- 172.21.15.89:0/542173948 >> v2:172.21.15.121:3300/0 conn(0x7f301406abd0 0x7f30140b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3012d9d640 1 -- 172.21.15.89:0/542173948 >> v1:172.21.15.89:6789/0 conn(0x7f3014070320 legacy=0x7f3014144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f3012d9d640 1 -- 172.21.15.89:0/542173948 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301414b470 con 0x7f301414aae0 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.928+0000 7f301159a640 1 -- 172.21.15.89:0/542173948 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662635020 0 0) 0x7f301406ff50 con 0x7f3014070320 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.929+0000 7f3012d9d640 1 --2- 172.21.15.89:0/542173948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301414af30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30140b8f10 tx=0x7f300c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6154f9de9ea9bd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.929+0000 7f301159a640 1 -- 172.21.15.89:0/542173948 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c02cd00 con 0x7f301414aae0 2023-08-25T09:41:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.929+0000 7f301159a640 1 -- 172.21.15.89:0/542173948 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c02ce60 con 0x7f301414aae0 2023-08-25T09:41:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.929+0000 7f301159a640 1 -- 172.21.15.89:0/542173948 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c034660 con 0x7f301414aae0 2023-08-25T09:41:38.935 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 -- 172.21.15.89:0/542173948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 msgr2=0x7f301414af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 --2- 172.21.15.89:0/542173948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301414af30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30140b8f10 tx=0x7f300c02bf50 comp rx=0 tx=0).stop 2023-08-25T09:41:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 -- 172.21.15.89:0/542173948 shutdown_connections 2023-08-25T09:41:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 --2- 172.21.15.89:0/542173948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301414af30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 --2- 172.21.15.89:0/542173948 >> v2:172.21.15.121:3300/0 conn(0x7f301406abd0 0x7f30140b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 -- 172.21.15.89:0/542173948 >> 172.21.15.89:0/542173948 conn(0x7f30140bcfc0 msgr2=0x7f30140bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 -- 172.21.15.89:0/542173948 shutdown_connections 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.930+0000 7f3018d01640 1 -- 172.21.15.89:0/542173948 wait complete. 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.931+0000 7f3018d01640 1 Processor -- start 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.931+0000 7f3018d01640 1 -- start start 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3018d01640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f301406abd0 0x7f301414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3018d01640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 0x7f3014138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3018d01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301413b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3018d01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301414a680 con 0x7f301414aae0 2023-08-25T09:41:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3018d01640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141392e0 con 0x7f3014070320 2023-08-25T09:41:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3018d01640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301413b120 con 0x7f301406abd0 2023-08-25T09:41:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301413b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3011d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 0x7f3014138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f301259c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f301406abd0 0x7f301414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3011d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 0x7f3014138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:45662/0 (socket says 172.21.15.89:45662) 2023-08-25T09:41:38.938 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301413b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41826/0 (socket says 172.21.15.89:41826) 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3011d9b640 1 -- 172.21.15.89:0/4098875988 learned_addr learned my addr 172.21.15.89:0/4098875988 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 -- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f301406abd0 msgr2=0x7f301414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f301406abd0 0x7f301414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 -- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 msgr2=0x7f3014138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 0x7f3014138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 -- 172.21.15.89:0/4098875988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c009a70 con 0x7f301414aae0 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3011d9b640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 0x7f3014138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:38.939 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f3012d9d640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301413b5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f301406b430 tx=0x7f300c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.932+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c03d600 con 0x7f301414aae0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c03d760 con 0x7f301414aae0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30141372d0 con 0x7f301414aae0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c03db10 con 0x7f301414aae0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301413a090 con 0x7f301414aae0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f300c03b040 con 0x7f301414aae0 2023-08-25T09:41:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f300c03ca30 con 0x7f301414aae0 2023-08-25T09:41:38.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.933+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301406b930 con 0x7f301414aae0 2023-08-25T09:41:38.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.935+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f300c04d060 con 0x7f301414aae0 2023-08-25T09:41:38.944 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:38.942+0000 7fda8a047040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T09:41:38.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.996+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3014066c50 con 0x7f301414aae0 2023-08-25T09:41:38.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.996+0000 7f300affd640 1 -- 172.21.15.89:0/4098875988 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f300c055090 con 0x7f301414aae0 2023-08-25T09:41:39.001 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:39.001 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":10,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:41:38.743580+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:41:39.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 msgr2=0x7f301413b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301413b5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f301406b430 tx=0x7f300c004a40 comp rx=0 tx=0).stop 2023-08-25T09:41:39.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 shutdown_connections 2023-08-25T09:41:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f301414aae0 0x7f301413b5b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014070320 0x7f3014138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 --2- 172.21.15.89:0/4098875988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f301406abd0 0x7f301414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 >> 172.21.15.89:0/4098875988 conn(0x7f30140bcfc0 msgr2=0x7f30141425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 shutdown_connections 2023-08-25T09:41:39.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:38.997+0000 7f3018d01640 1 -- 172.21.15.89:0/4098875988 wait complete. 2023-08-25T09:41:39.007 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.005+0000 7f301bc26040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T09:41:39.009 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-25T09:41:39.009 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-25T09:41:39.049 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.046+0000 7f301bc26040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T09:41:39.084 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:39.082+0000 7fda8a047040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T09:41:39.181 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.180+0000 7f301bc26040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T09:41:39.377 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T09:41:39.375+0000 7fe3a3c13500 -1 Falling back to public interface 2023-08-25T09:41:39.393 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T09:41:39.391+0000 7f071fbbc500 -1 Falling back to public interface 2023-08-25T09:41:39.395 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T09:41:39.392+0000 7efeb1b45500 -1 Falling back to public interface 2023-08-25T09:41:39.396 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T09:41:39.392+0000 7fee4a434500 -1 Falling back to public interface 2023-08-25T09:41:39.397 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T09:41:39.394+0000 7efeb0aec640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6822/0: (98) Address already in use 2023-08-25T09:41:39.397 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T09:41:39.394+0000 7fee493db640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6824/0: (98) Address already in use 2023-08-25T09:41:39.408 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T09:41:39.401+0000 7f4993213500 -1 Falling back to public interface 2023-08-25T09:41:39.408 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T09:41:39.402+0000 7fdebbca7500 -1 Falling back to public interface 2023-08-25T09:41:39.444 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T09:41:39.442+0000 7f7e961ad500 -1 Falling back to public interface 2023-08-25T09:41:39.447 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T09:41:39.445+0000 7f30d0c0f500 -1 Falling back to public interface 2023-08-25T09:41:39.465 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:39.463+0000 7fda8a047040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-25T09:41:39.561 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.559+0000 7f301bc26040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-25T09:41:39.660 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:39.658+0000 7fda8a047040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T09:41:39.713 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:39.711+0000 7fda8a047040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T09:41:39.758 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.755+0000 7f301bc26040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T09:41:39.759 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:39.755+0000 7fda8a047040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T09:41:39.808 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:39.806+0000 7fda8a047040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T09:41:39.808 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.807+0000 7f301bc26040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T09:41:39.816 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T09:41:39.853 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.851+0000 7f301bc26040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T09:41:39.904 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:39.903+0000 7f301bc26040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T09:41:39.905 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.904+0000 7fa926f55640 1 Processor -- start 2023-08-25T09:41:39.905 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.904+0000 7fa926f55640 1 -- start start 2023-08-25T09:41:39.908 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.904+0000 7fa926f55640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa92006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:39.909 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa926f55640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9200b8e60 con 0x7fa92014de10 2023-08-25T09:41:39.909 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa926f55640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9200be530 con 0x7fa92006c640 2023-08-25T09:41:39.909 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa926f55640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b9770 con 0x7fa920144b30 2023-08-25T09:41:39.909 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa9254f2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa92014de10 0x7fa92014e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47708/0 (socket says 172.21.15.89:47708) 2023-08-25T09:41:39.909 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa9254f2640 1 -- 172.21.15.89:0/9892603 learned_addr learned my addr 172.21.15.89:0/9892603 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:39.909 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa924cf1640 1 --2- 172.21.15.89:0/9892603 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa92006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021261487 0 0) 0x7fa9200b8e60 con 0x7fa92014de10 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa910003520 con 0x7fa92014de10 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304352268 0 0) 0x7fa9200be530 con 0x7fa92006c640 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9200b8e60 con 0x7fa92006c640 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa924cf1640 1 -- 172.21.15.89:0/9892603 >> v1:172.21.15.121:6789/0 conn(0x7fa92006c640 legacy=0x7fa9200bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa924cf1640 1 -- 172.21.15.89:0/9892603 >> v1:172.21.15.89:6789/0 conn(0x7fa92014de10 legacy=0x7fa92014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.910 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.905+0000 7fa924cf1640 1 -- 172.21.15.89:0/9892603 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200b90b0 con 0x7fa920144b30 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.906+0000 7fa924cf1640 1 --2- 172.21.15.89:0/9892603 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa92006a960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa9140097c0 tx=0x7fa91402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f26cae73b3162a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.906+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914031890 con 0x7fa920144b30 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.906+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9140319f0 con 0x7fa920144b30 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.906+0000 7fa91f7fe640 1 -- 172.21.15.89:0/9892603 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914031d80 con 0x7fa920144b30 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 -- 172.21.15.89:0/9892603 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 msgr2=0x7fa92006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 --2- 172.21.15.89:0/9892603 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa92006a960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa9140097c0 tx=0x7fa91402b930 comp rx=0 tx=0).stop 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 -- 172.21.15.89:0/9892603 shutdown_connections 2023-08-25T09:41:39.911 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 --2- 172.21.15.89:0/9892603 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa92006a960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.912 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 -- 172.21.15.89:0/9892603 >> 172.21.15.89:0/9892603 conn(0x7fa920070920 msgr2=0x7fa9200714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:39.912 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 -- 172.21.15.89:0/9892603 shutdown_connections 2023-08-25T09:41:39.912 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.907+0000 7fa926f55640 1 -- 172.21.15.89:0/9892603 wait complete. 2023-08-25T09:41:39.914 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 Processor -- start 2023-08-25T09:41:39.914 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 -- start start 2023-08-25T09:41:39.914 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 0x7fa920146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:39.914 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa9201455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92014de10 0x7fa92014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92014ae00 con 0x7fa92006c640 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa920145ae0 con 0x7fa92014de10 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.908+0000 7fa926f55640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa920147a40 con 0x7fa920144b30 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 0x7fa920146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 0x7fa920146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41840/0 (socket says 172.21.15.89:41840) 2023-08-25T09:41:39.915 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 -- 172.21.15.89:0/3600717312 learned_addr learned my addr 172.21.15.89:0/3600717312 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:39.916 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa9254f2640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92014de10 0x7fa92014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:39.916 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa91ffff640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa9201455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:39.916 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 -- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 msgr2=0x7fa9201455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.916 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa9201455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.916 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 -- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92014de10 msgr2=0x7fa92014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92014de10 0x7fa92014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 -- 172.21.15.89:0/3600717312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140093a0 con 0x7fa92006c640 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa924cf1640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 0x7fa920146a10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098e0 tx=0x7fa9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91403bbf0 con 0x7fa92006c640 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91403bd50 con 0x7fa92006c640 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920147030 con 0x7fa92006c640 2023-08-25T09:41:39.917 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914045630 con 0x7fa92006c640 2023-08-25T09:41:39.918 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9201475f0 con 0x7fa92006c640 2023-08-25T09:41:39.918 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.909+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa914045a90 con 0x7fa92006c640 2023-08-25T09:41:39.918 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.910+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa914030ab0 con 0x7fa92006c640 2023-08-25T09:41:39.918 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.910+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92004dbd0 con 0x7fa92006c640 2023-08-25T09:41:39.918 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.912+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa914035020 con 0x7fa92006c640 2023-08-25T09:41:39.974 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.973+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa920148090 con 0x7fa92006c640 2023-08-25T09:41:39.975 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.974+0000 7fa91d7fa640 1 -- 172.21.15.89:0/3600717312 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa914030d10 con 0x7fa92006c640 2023-08-25T09:41:39.975 INFO:teuthology.misc.health.smithi089.stdout: 2023-08-25T09:41:39.976 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":10,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:41:38.743580+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 msgr2=0x7fa920146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 0x7fa920146a10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098e0 tx=0x7fa9140046c0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 shutdown_connections 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92014de10 0x7fa92014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa920144b30 0x7fa9201455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 --2- 172.21.15.89:0/3600717312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c640 0x7fa920146a10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:39.977 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 >> 172.21.15.89:0/3600717312 conn(0x7fa920070920 msgr2=0x7fa920143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:39.978 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 shutdown_connections 2023-08-25T09:41:39.978 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:39.975+0000 7fa926f55640 1 -- 172.21.15.89:0/3600717312 wait complete. 2023-08-25T09:41:39.985 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-25T09:41:40.085 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.084+0000 7fda8a047040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T09:41:40.136 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.135+0000 7fda8a047040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T09:41:40.173 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.171+0000 7f301bc26040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T09:41:40.200 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.199+0000 7fda8a047040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T09:41:40.225 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.224+0000 7f301bc26040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T09:41:40.285 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.283+0000 7f301bc26040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T09:41:40.342 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.341+0000 7fda8a047040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-25T09:41:40.384 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.382+0000 7fda8a047040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T09:41:40.425 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.424+0000 7f301bc26040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-25T09:41:40.436 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.433+0000 7fda8a047040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T09:41:40.467 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.465+0000 7f301bc26040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T09:41:40.479 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:40.478+0000 7fda8a047040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T09:41:40.520 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.519+0000 7f301bc26040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T09:41:40.568 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-08-25T09:41:40.566+0000 7f301bc26040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T09:41:41.514 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:41.513+0000 7fda2b3fe640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-25T09:41:41.514 INFO:tasks.ceph.mgr.y.smithi089.stderr:2023-08-25T09:41:41.513+0000 7fda2b3fe640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-25T09:41:42.863 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T09:41:42.862+0000 7fe3a3c13500 -1 osd.1 0 log_to_monitors true 2023-08-25T09:41:42.889 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T09:41:42.887+0000 7f4993213500 -1 osd.4 0 log_to_monitors true 2023-08-25T09:41:42.906 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T09:41:42.904+0000 7fdebbca7500 -1 osd.5 0 log_to_monitors true 2023-08-25T09:41:42.924 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T09:41:42.923+0000 7f071fbbc500 -1 osd.0 0 log_to_monitors true 2023-08-25T09:41:42.932 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T09:41:42.931+0000 7fee4a434500 -1 osd.2 0 log_to_monitors true 2023-08-25T09:41:42.936 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T09:41:42.935+0000 7efeb1b45500 -1 osd.3 0 log_to_monitors true 2023-08-25T09:41:42.949 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T09:41:42.948+0000 7f7e961ad500 -1 osd.6 0 log_to_monitors true 2023-08-25T09:41:42.975 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T09:41:42.973+0000 7f30d0c0f500 -1 osd.7 0 log_to_monitors true 2023-08-25T09:41:46.619 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T09:41:46.617+0000 7f30cbd52640 -1 osd.7 0 waiting for initial osdmap 2023-08-25T09:41:46.627 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T09:41:46.626+0000 7f7e91918640 -1 osd.6 0 waiting for initial osdmap 2023-08-25T09:41:46.628 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T09:41:46.627+0000 7f071b325640 -1 osd.0 0 waiting for initial osdmap 2023-08-25T09:41:46.628 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T09:41:46.627+0000 7f30c4384640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.636 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T09:41:46.635+0000 7f7e89f4a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.640 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T09:41:46.639+0000 7f0713957640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.659 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T09:41:46.658+0000 7efead2ae640 -1 osd.3 0 waiting for initial osdmap 2023-08-25T09:41:46.673 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T09:41:46.672+0000 7efea58e0640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.693 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T09:41:46.692+0000 7fdeb7410640 -1 osd.5 0 waiting for initial osdmap 2023-08-25T09:41:46.697 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T09:41:46.696+0000 7fee45b9d640 -1 osd.2 0 waiting for initial osdmap 2023-08-25T09:41:46.704 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T09:41:46.703+0000 7fe39ee26640 -1 osd.1 0 waiting for initial osdmap 2023-08-25T09:41:46.706 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T09:41:46.705+0000 7fdeafa42640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.714 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T09:41:46.713+0000 7fee3e1cf640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.716 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T09:41:46.715+0000 7f498e3d9640 -1 osd.4 0 waiting for initial osdmap 2023-08-25T09:41:46.720 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T09:41:46.719+0000 7fe397458640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.729 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T09:41:46.728+0000 7f4986a0b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T09:41:46.794 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T09:41:46.883 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 Processor -- start 2023-08-25T09:41:46.883 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 -- start start 2023-08-25T09:41:46.885 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06880709f0 0x7f06881486d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:46.885 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0688142510 0x7f0688142980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:46.885 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0688148c10 con 0x7f068814c8b0 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068814c420 con 0x7f0688142510 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.882+0000 7f068f742640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06880b3c10 con 0x7f06880709f0 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0688142510 0x7f0688142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0688142510 0x7f0688142980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50152/0 (socket says 172.21.15.89:50152) 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068ccdd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f068814c8b0 0x7f06880b3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37660/0 (socket says 172.21.15.89:37660) 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 -- 172.21.15.89:0/1744143082 learned_addr learned my addr 172.21.15.89:0/1744143082 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068d4de640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06880709f0 0x7f06881486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:46.886 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 -- 172.21.15.89:0/1744143082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06880709f0 msgr2=0x7f06881486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06880709f0 0x7f06881486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 -- 172.21.15.89:0/1744143082 >> v1:172.21.15.89:6789/0 conn(0x7f068814c8b0 legacy=0x7f06880b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f067ffff640 1 -- 172.21.15.89:0/1744143082 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844687353 0 0) 0x7f0688148c10 con 0x7f068814c8b0 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068dcdf640 1 -- 172.21.15.89:0/1744143082 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068814bdd0 con 0x7f0688142510 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.883+0000 7f068d4de640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06880709f0 0x7f06881486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068dcdf640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0688142510 0x7f0688142980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0680009e50 tx=0x7f068002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fe4d7e1f2c42be server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:46.887 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f067ffff640 1 -- 172.21.15.89:0/1744143082 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068002ca70 con 0x7f0688142510 2023-08-25T09:41:46.888 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f067ffff640 1 -- 172.21.15.89:0/1744143082 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068002cbd0 con 0x7f0688142510 2023-08-25T09:41:46.888 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f067ffff640 1 -- 172.21.15.89:0/1744143082 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800343f0 con 0x7f0688142510 2023-08-25T09:41:46.890 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 -- 172.21.15.89:0/1744143082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0688142510 msgr2=0x7f0688142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:46.890 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0688142510 0x7f0688142980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0680009e50 tx=0x7f068002bed0 comp rx=0 tx=0).stop 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 -- 172.21.15.89:0/1744143082 shutdown_connections 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0688142510 0x7f0688142980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 --2- 172.21.15.89:0/1744143082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06880709f0 0x7f06881486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 -- 172.21.15.89:0/1744143082 >> 172.21.15.89:0/1744143082 conn(0x7f0688071760 msgr2=0x7f0688069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 -- 172.21.15.89:0/1744143082 shutdown_connections 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.884+0000 7f068f742640 1 -- 172.21.15.89:0/1744143082 wait complete. 2023-08-25T09:41:46.891 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.885+0000 7f068f742640 1 Processor -- start 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 -- start start 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 0x7f0688140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0688142510 0x7f06881e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f068814c8b0 0x7f06881e1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688144c40 con 0x7f06880709f0 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0688145950 con 0x7f0688142510 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068f742640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06880b76c0 con 0x7f068814c8b0 2023-08-25T09:41:46.892 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 0x7f0688140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 0x7f0688140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50162/0 (socket says 172.21.15.89:50162) 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 -- 172.21.15.89:0/299812352 learned_addr learned my addr 172.21.15.89:0/299812352 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 -- 172.21.15.89:0/299812352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f068814c8b0 msgr2=0x7f06881e1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f068814c8b0 0x7f06881e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 -- 172.21.15.89:0/299812352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0688142510 msgr2=0x7f06881e0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0688142510 0x7f06881e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:46.893 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.886+0000 7f068d4de640 1 -- 172.21.15.89:0/299812352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009b30 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.887+0000 7f068d4de640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 0x7f0688140220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f068400e840 tx=0x7f068400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.887+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684004030 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.887+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684004190 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.887+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0688140760 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.887+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684005990 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.887+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068813f760 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.888+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f0684005af0 con 0x7f06880709f0 2023-08-25T09:41:46.894 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.888+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068804dbd0 con 0x7f06880709f0 2023-08-25T09:41:46.895 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.888+0000 7f067dffb640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f066c069fc0 0x7f066c06c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:46.895 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.888+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f0684087570 con 0x7f06880709f0 2023-08-25T09:41:46.895 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.888+0000 7f068ccdd640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f066c069fc0 0x7f066c06c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:46.895 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.889+0000 7f068ccdd640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f066c069fc0 0x7f066c06c480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:46.895 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:46.893+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0684053cc0 con 0x7f06880709f0 2023-08-25T09:41:47.060 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.059+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0688069d10 con 0x7f06880709f0 2023-08-25T09:41:47.061 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.059+0000 7f067dffb640 1 -- 172.21.15.89:0/299812352 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f06840572e0 con 0x7f06880709f0 2023-08-25T09:41:47.062 INFO:teuthology.misc.health.smithi089.stdout: 2023-08-25T09:41:47.062 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":12,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:41:44.530806+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:41:47.063 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f066c069fc0 msgr2=0x7f066c06c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:47.063 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f066c069fc0 0x7f066c06c480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0678007fd0 tx=0x7f0678007960 comp rx=0 tx=0).stop 2023-08-25T09:41:47.064 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 msgr2=0x7f0688140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:47.064 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 0x7f0688140220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f068400e840 tx=0x7f068400ed00 comp rx=0 tx=0).stop 2023-08-25T09:41:47.064 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 shutdown_connections 2023-08-25T09:41:47.064 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f066c069fc0 0x7f066c06c480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:47.065 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f068814c8b0 0x7f06881e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:47.065 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0688142510 0x7f06881e0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:47.065 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 --2- 172.21.15.89:0/299812352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06880709f0 0x7f0688140220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:47.065 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 >> 172.21.15.89:0/299812352 conn(0x7f0688071760 msgr2=0x7f06880ba450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:47.066 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 shutdown_connections 2023-08-25T09:41:47.066 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:47.061+0000 7f068f742640 1 -- 172.21.15.89:0/299812352 wait complete. 2023-08-25T09:41:47.072 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-25T09:41:53.881 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T09:41:53.980 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.979+0000 7ff409f76640 1 Processor -- start 2023-08-25T09:41:53.981 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.979+0000 7ff409f76640 1 -- start start 2023-08-25T09:41:53.982 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff409f76640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff404144970 0x7ff40406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:53.983 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff409f76640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff40414bdf0 0x7ff404155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:53.983 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff409f76640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040be5e0 con 0x7ff40406bee0 2023-08-25T09:41:53.983 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff409f76640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40406b380 con 0x7ff40414bdf0 2023-08-25T09:41:53.984 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff409f76640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40406c410 con 0x7ff404144970 2023-08-25T09:41:53.984 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff403fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff40414bdf0 0x7ff404155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:53.984 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff402ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff40406bee0 0x7ff4040bded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37664/0 (socket says 172.21.15.89:37664) 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff402ffd640 1 -- 172.21.15.89:0/1241268905 learned_addr learned my addr 172.21.15.89:0/1241268905 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff4037fe640 1 --2- 172.21.15.89:0/1241268905 >> v2:172.21.15.121:3300/0 conn(0x7ff404144970 0x7ff40406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff403fff640 1 -- 172.21.15.89:0/1241268905 >> v2:172.21.15.121:3300/0 conn(0x7ff404144970 msgr2=0x7ff40406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff403fff640 1 --2- 172.21.15.89:0/1241268905 >> v2:172.21.15.121:3300/0 conn(0x7ff404144970 0x7ff40406ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff403fff640 1 -- 172.21.15.89:0/1241268905 >> v1:172.21.15.89:6789/0 conn(0x7ff40406bee0 legacy=0x7ff4040bded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff4027fc640 1 -- 172.21.15.89:0/1241268905 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763471565 0 0) 0x7ff4040be5e0 con 0x7ff40406bee0 2023-08-25T09:41:53.985 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff403fff640 1 -- 172.21.15.89:0/1241268905 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40414aa10 con 0x7ff40414bdf0 2023-08-25T09:41:53.986 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.980+0000 7ff4037fe640 1 --2- 172.21.15.89:0/1241268905 >> v2:172.21.15.121:3300/0 conn(0x7ff404144970 0x7ff40406ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:53.986 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.981+0000 7ff403fff640 1 --2- 172.21.15.89:0/1241268905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff404155280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4040bedb0 tx=0x7ff3fc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6d980dd87ed376 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:53.986 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.981+0000 7ff4027fc640 1 -- 172.21.15.89:0/1241268905 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc02cbf0 con 0x7ff40414bdf0 2023-08-25T09:41:53.986 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.981+0000 7ff4027fc640 1 -- 172.21.15.89:0/1241268905 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc02cd50 con 0x7ff40414bdf0 2023-08-25T09:41:53.986 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.981+0000 7ff4027fc640 1 -- 172.21.15.89:0/1241268905 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc034660 con 0x7ff40414bdf0 2023-08-25T09:41:53.989 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 -- 172.21.15.89:0/1241268905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 msgr2=0x7ff404155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:53.989 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 --2- 172.21.15.89:0/1241268905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff404155280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4040bedb0 tx=0x7ff3fc02be40 comp rx=0 tx=0).stop 2023-08-25T09:41:53.989 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 -- 172.21.15.89:0/1241268905 shutdown_connections 2023-08-25T09:41:53.990 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 --2- 172.21.15.89:0/1241268905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff404155280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:53.990 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 --2- 172.21.15.89:0/1241268905 >> v2:172.21.15.121:3300/0 conn(0x7ff404144970 0x7ff40406ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:53.990 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 -- 172.21.15.89:0/1241268905 >> 172.21.15.89:0/1241268905 conn(0x7ff404065760 msgr2=0x7ff404070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:53.990 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 -- 172.21.15.89:0/1241268905 shutdown_connections 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.982+0000 7ff409f76640 1 -- 172.21.15.89:0/1241268905 wait complete. 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.983+0000 7ff409f76640 1 Processor -- start 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.983+0000 7ff409f76640 1 -- start start 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff40406bee0 0x7ff404147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff404144970 0x7ff404148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff4041e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:53.991 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404148380 con 0x7ff40414bdf0 2023-08-25T09:41:53.992 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041e0450 con 0x7ff404144970 2023-08-25T09:41:53.992 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4040b7030 con 0x7ff40406bee0 2023-08-25T09:41:53.992 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff4041e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:53.992 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff4041e0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50198/0 (socket says 172.21.15.89:50198) 2023-08-25T09:41:53.992 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 -- 172.21.15.89:0/675870193 learned_addr learned my addr 172.21.15.89:0/675870193 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff402ffd640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff404144970 0x7ff404148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff4037fe640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff40406bee0 0x7ff404147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 -- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff40406bee0 msgr2=0x7ff404147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff40406bee0 0x7ff404147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 -- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff404144970 msgr2=0x7ff404148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff404144970 0x7ff404148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:53.993 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 -- 172.21.15.89:0/675870193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc009a70 con 0x7ff40414bdf0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff403fff640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff4041e0930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc02c450 tx=0x7ff3fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc03e610 con 0x7ff40414bdf0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc03e770 con 0x7ff40414bdf0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4040b7310 con 0x7ff40414bdf0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc03eb20 con 0x7ff40414bdf0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.984+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4040b75f0 con 0x7ff40414bdf0 2023-08-25T09:41:53.994 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.985+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4041e0650 con 0x7ff40414bdf0 2023-08-25T09:41:53.995 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.986+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff3fc03b050 con 0x7ff40414bdf0 2023-08-25T09:41:53.995 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.986+0000 7ff3ebfff640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff3f006a050 0x7ff3f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:53.995 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.986+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3fc0aa860 con 0x7ff40414bdf0 2023-08-25T09:41:53.995 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.986+0000 7ff4037fe640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff3f006a050 0x7ff3f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:53.995 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.987+0000 7ff4037fe640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff3f006a050 0x7ff3f006c510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400a990 tx=0x7ff3f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:53.996 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:53.991+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff4041e0650 con 0x7ff40414bdf0 2023-08-25T09:41:54.159 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.158+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff404065df0 con 0x7ff40414bdf0 2023-08-25T09:41:54.162 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.159+0000 7ff3ebfff640 1 -- 172.21.15.89:0/675870193 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7ff3fc039090 con 0x7ff40414bdf0 2023-08-25T09:41:54.163 INFO:teuthology.misc.health.smithi089.stdout: 2023-08-25T09:41:54.163 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":16,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:41:50.635679+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:41:54.164 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff3f006a050 msgr2=0x7ff3f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:54.164 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff3f006a050 0x7ff3f006c510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400a990 tx=0x7ff3f4008040 comp rx=0 tx=0).stop 2023-08-25T09:41:54.164 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 msgr2=0x7ff4041e0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:54.165 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff4041e0930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc02c450 tx=0x7ff3fc004a40 comp rx=0 tx=0).stop 2023-08-25T09:41:54.165 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 shutdown_connections 2023-08-25T09:41:54.166 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff3f006a050 0x7ff3f006c510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.166 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40414bdf0 0x7ff4041e0930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.166 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff404144970 0x7ff404148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.166 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 --2- 172.21.15.89:0/675870193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff40406bee0 0x7ff404147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.166 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 >> 172.21.15.89:0/675870193 conn(0x7ff404065760 msgr2=0x7ff404140da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:54.166 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 shutdown_connections 2023-08-25T09:41:54.167 INFO:teuthology.misc.health.smithi089.stderr:2023-08-25T09:41:54.161+0000 7ff409f76640 1 -- 172.21.15.89:0/675870193 wait complete. 2023-08-25T09:41:54.175 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-25T09:41:54.176 INFO:tasks.ceph:Creating RBD pool 2023-08-25T09:41:54.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-25T09:41:54.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.289+0000 7f74aa3cf640 1 Processor -- start 2023-08-25T09:41:54.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.289+0000 7f74aa3cf640 1 -- start start 2023-08-25T09:41:54.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74aa3cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74a4140f00 0x7f74a406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74aa3cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74aa3cf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f74a4146cf0 0x7f74a406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74aa3cf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40b6380 con 0x7f74a4140f00 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74aa3cf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a4147b90 con 0x7f74a4146cf0 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74aa3cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b33a0 con 0x7f74a4071420 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74a4140f00 0x7f74a406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74a4140f00 0x7f74a406e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50202/0 (socket says 172.21.15.89:50202) 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 -- 172.21.15.89:0/10171544 learned_addr learned my addr 172.21.15.89:0/10171544 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a896c640 1 --2- 172.21.15.89:0/10171544 >> v2:172.21.15.121:3300/0 conn(0x7f74a4146cf0 0x7f74a406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a37fe640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 -- 172.21.15.89:0/10171544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 msgr2=0x7f74a406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a406eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 -- 172.21.15.89:0/10171544 >> v2:172.21.15.121:3300/0 conn(0x7f74a4146cf0 msgr2=0x7f74a406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 --2- 172.21.15.89:0/10171544 >> v2:172.21.15.121:3300/0 conn(0x7f74a4146cf0 0x7f74a406fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a3fff640 1 -- 172.21.15.89:0/10171544 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4147260 con 0x7f74a4140f00 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a896c640 1 --2- 172.21.15.89:0/10171544 >> v2:172.21.15.121:3300/0 conn(0x7f74a4146cf0 0x7f74a406fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:54.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.290+0000 7f74a37fe640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:54.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.291+0000 7f74a3fff640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a406e860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74a406ad00 tx=0x7f749402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4e5afd07399912 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:54.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.291+0000 7f74a2ffd640 1 -- 172.21.15.89:0/10171544 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940317d0 con 0x7f74a4140f00 2023-08-25T09:41:54.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.291+0000 7f74a2ffd640 1 -- 172.21.15.89:0/10171544 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494031930 con 0x7f74a4140f00 2023-08-25T09:41:54.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.291+0000 7f74a2ffd640 1 -- 172.21.15.89:0/10171544 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494031cc0 con 0x7f74a4140f00 2023-08-25T09:41:54.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.291+0000 7f74aa3cf640 1 -- 172.21.15.89:0/10171544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 msgr2=0x7f74a406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:54.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.291+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a406e860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74a406ad00 tx=0x7f749402b870 comp rx=0 tx=0).stop 2023-08-25T09:41:54.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 -- 172.21.15.89:0/10171544 shutdown_connections 2023-08-25T09:41:54.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/10171544 >> v2:172.21.15.121:3300/0 conn(0x7f74a4146cf0 0x7f74a406fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/10171544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a406e860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 -- 172.21.15.89:0/10171544 >> 172.21.15.89:0/10171544 conn(0x7f74a40bbe80 msgr2=0x7f74a40bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 -- 172.21.15.89:0/10171544 shutdown_connections 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.292+0000 7f74aa3cf640 1 -- 172.21.15.89:0/10171544 wait complete. 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 Processor -- start 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 -- start start 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a4139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a41dd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74a4146cf0 0x7f74a4138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4139bb0 con 0x7f74a4140f00 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41376f0 con 0x7f74a4146cf0 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74aa3cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4138950 con 0x7f74a4071420 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74a37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a41dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74a37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a41dd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50216/0 (socket says 172.21.15.89:50216) 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.293+0000 7f74a37fe640 1 -- 172.21.15.89:0/2727584078 learned_addr learned my addr 172.21.15.89:0/2727584078 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:54.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a896c640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74a4146cf0 0x7f74a4138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a3fff640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a4139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a37fe640 1 -- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 msgr2=0x7f74a4139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a37fe640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a4139670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a37fe640 1 -- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74a4146cf0 msgr2=0x7f74a4138080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a37fe640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74a4146cf0 0x7f74a4138080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a37fe640 1 -- 172.21.15.89:0/2727584078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094d0 con 0x7f74a4140f00 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a896c640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74a4146cf0 0x7f74a4138080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:54.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a37fe640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a41dd800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f749800c7f0 tx=0x7f749800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800cea0 con 0x7f74a4140f00 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498007a30 con 0x7f74a4140f00 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498007dc0 con 0x7f74a4140f00 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a4137380 con 0x7f74a4140f00 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.294+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a41385c0 con 0x7f74a4140f00 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.295+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a41371e0 con 0x7f74a4140f00 2023-08-25T09:41:54.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.296+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74980113f0 con 0x7f74a4140f00 2023-08-25T09:41:54.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.296+0000 7f74a0ff9640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f749006a050 0x7f749006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:54.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.296+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7498088270 con 0x7f74a4140f00 2023-08-25T09:41:54.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.296+0000 7f74a3fff640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f749006a050 0x7f749006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:54.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.296+0000 7f74a3fff640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f749006a050 0x7f749006c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7494036000 tx=0x7f749403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:54.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.300+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f74a41371e0 con 0x7f74a4140f00 2023-08-25T09:41:54.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:54.464+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f74a41371e0 con 0x7f74a4140f00 2023-08-25T09:41:55.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.219+0000 7f74a0ff9640 1 -- 172.21.15.89:0/2727584078 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f74a41371e0 con 0x7f74a4140f00 2023-08-25T09:41:55.222 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2023-08-25T09:41:55.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f749006a050 msgr2=0x7f749006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f749006a050 0x7f749006c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7494036000 tx=0x7f749403d040 comp rx=0 tx=0).stop 2023-08-25T09:41:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 msgr2=0x7f74a41dd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a41dd800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f749800c7f0 tx=0x7f749800ccb0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 shutdown_connections 2023-08-25T09:41:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f749006a050 0x7f749006c510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74a4140f00 0x7f74a41dd800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74a4146cf0 0x7f74a4138080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 --2- 172.21.15.89:0/2727584078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74a4071420 0x7f74a4139670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 >> 172.21.15.89:0/2727584078 conn(0x7f74a40bbe80 msgr2=0x7f74a4143880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 shutdown_connections 2023-08-25T09:41:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.222+0000 7f74aa3cf640 1 -- 172.21.15.89:0/2727584078 wait complete. 2023-08-25T09:41:55.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-25T09:41:55.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.346+0000 7f45e03a4640 1 Processor -- start 2023-08-25T09:41:55.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.346+0000 7f45e03a4640 1 -- start start 2023-08-25T09:41:55.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45e03a4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 0x7f45d814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:55.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45e03a4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f45d81533a0 0x7f45d8155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:55.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45e03a4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d80bc460 con 0x7f45d80a54b0 2023-08-25T09:41:55.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45e03a4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d806abd0 con 0x7f45d81533a0 2023-08-25T09:41:55.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45e03a4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d806a8f0 con 0x7f45d80bae10 2023-08-25T09:41:55.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45de941640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f45d81533a0 0x7f45d8155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:55.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45de140640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 0x7f45d814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:55.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45de941640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f45d81533a0 0x7f45d8155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:42910/0 (socket says 172.21.15.89:42910) 2023-08-25T09:41:55.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45de140640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 0x7f45d814ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49312/0 (socket says 172.21.15.89:49312) 2023-08-25T09:41:55.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45dd93f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f45d80a54b0 0x7f45d80a58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:57204/0 (socket says 172.21.15.89:57204) 2023-08-25T09:41:55.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.347+0000 7f45de941640 1 -- 172.21.15.89:0/1670899409 learned_addr learned my addr 172.21.15.89:0/1670899409 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:55.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.348+0000 7f45de941640 1 -- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 msgr2=0x7f45d814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:55.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.348+0000 7f45de941640 1 --2- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 0x7f45d814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.348+0000 7f45de941640 1 -- 172.21.15.89:0/1670899409 >> v1:172.21.15.121:6789/0 conn(0x7f45d80a54b0 legacy=0x7f45d80a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:55.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.348+0000 7f45de941640 1 -- 172.21.15.89:0/1670899409 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d806a4b0 con 0x7f45d81533a0 2023-08-25T09:41:55.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.348+0000 7f45de140640 1 --2- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 0x7f45d814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:55.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45de941640 1 --2- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d81533a0 0x7f45d8155790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009870 tx=0x7f45d002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc673783e741771 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:55.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45dd13e640 1 -- 172.21.15.89:0/1670899409 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0030840 con 0x7f45d81533a0 2023-08-25T09:41:55.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45dd13e640 1 -- 172.21.15.89:0/1670899409 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d00309a0 con 0x7f45d81533a0 2023-08-25T09:41:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45dd13e640 1 -- 172.21.15.89:0/1670899409 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0030d30 con 0x7f45d81533a0 2023-08-25T09:41:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 -- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d81533a0 msgr2=0x7f45d8155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 --2- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d81533a0 0x7f45d8155790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009870 tx=0x7f45d002b980 comp rx=0 tx=0).stop 2023-08-25T09:41:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 -- 172.21.15.89:0/1670899409 shutdown_connections 2023-08-25T09:41:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 --2- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d81533a0 0x7f45d8155790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 --2- 172.21.15.89:0/1670899409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d80bae10 0x7f45d814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 -- 172.21.15.89:0/1670899409 >> 172.21.15.89:0/1670899409 conn(0x7f45d80c0220 msgr2=0x7f45d80c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 -- 172.21.15.89:0/1670899409 shutdown_connections 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.349+0000 7f45e03a4640 1 -- 172.21.15.89:0/1670899409 wait complete. 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.350+0000 7f45e03a4640 1 Processor -- start 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.350+0000 7f45e03a4640 1 -- start start 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45e03a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 0x7f45d81dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45e03a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d80bae10 0x7f45d814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45e03a4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d81533a0 0x7f45d814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45e03a4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80b6e10 con 0x7f45d80a54b0 2023-08-25T09:41:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45e03a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d80bee50 con 0x7f45d80bae10 2023-08-25T09:41:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45e03a4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81e04a0 con 0x7f45d81533a0 2023-08-25T09:41:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 0x7f45d81dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 0x7f45d81dfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50224/0 (socket says 172.21.15.89:50224) 2023-08-25T09:41:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 -- 172.21.15.89:0/3681777169 learned_addr learned my addr 172.21.15.89:0/3681777169 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de941640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d81533a0 0x7f45d814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45dd93f640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d80bae10 0x7f45d814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 -- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d81533a0 msgr2=0x7f45d814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d81533a0 0x7f45d814d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 -- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d80bae10 msgr2=0x7f45d814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d80bae10 0x7f45d814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.351+0000 7f45de140640 1 -- 172.21.15.89:0/3681777169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4009a70 con 0x7f45d80a54b0 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.352+0000 7f45de140640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 0x7f45d81dfbd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45d400efc0 tx=0x7f45d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.352+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4014680 con 0x7f45d80a54b0 2023-08-25T09:41:55.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.352+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400f040 con 0x7f45d80a54b0 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.352+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4014a00 con 0x7f45d80a54b0 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.352+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00094d0 con 0x7f45d80a54b0 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.352+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d814c8c0 con 0x7f45d80a54b0 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.353+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8073bf0 con 0x7f45d80a54b0 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.353+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45d4014b60 con 0x7f45d80a54b0 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.354+0000 7f45ceffd640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f45bc06a050 0x7f45bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:55.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.354+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f45d4089310 con 0x7f45d80a54b0 2023-08-25T09:41:55.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.354+0000 7f45dd93f640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f45bc06a050 0x7f45bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:55.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.354+0000 7f45dd93f640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f45bc06a050 0x7f45bc06c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45d80b6830 tx=0x7f45c8007c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:55.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.358+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f45d4054d60 con 0x7f45d80a54b0 2023-08-25T09:41:55.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:55.526+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45d814b420 con 0x7f45d80a54b0 2023-08-25T09:41:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.223+0000 7f45ceffd640 1 -- 172.21.15.89:0/3681777169 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f45d4087e60 con 0x7f45d80a54b0 2023-08-25T09:41:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-25T09:41:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f45bc06a050 msgr2=0x7f45bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f45bc06a050 0x7f45bc06c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45d80b6830 tx=0x7f45c8007c80 comp rx=0 tx=0).stop 2023-08-25T09:41:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 msgr2=0x7f45d81dfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 0x7f45d81dfbd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45d400efc0 tx=0x7f45d400c490 comp rx=0 tx=0).stop 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 shutdown_connections 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f45bc06a050 0x7f45bc06c510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45d81533a0 0x7f45d814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45d80bae10 0x7f45d814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 --2- 172.21.15.89:0/3681777169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45d80a54b0 0x7f45d81dfbd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 >> 172.21.15.89:0/3681777169 conn(0x7f45d80c0220 msgr2=0x7f45d814a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 shutdown_connections 2023-08-25T09:41:56.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.226+0000 7f45e03a4640 1 -- 172.21.15.89:0/3681777169 wait complete. 2023-08-25T09:41:56.241 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-25T09:41:56.242 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T09:41:56.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T09:41:56.245 INFO:tasks.ceph.mds.a:Started 2023-08-25T09:41:56.246 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T09:41:56.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T09:41:56.248 INFO:tasks.ceph.mds.c:Started 2023-08-25T09:41:56.249 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T09:41:56.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T09:41:56.253 INFO:tasks.ceph.mds.b:Started 2023-08-25T09:41:56.254 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-25T09:41:56.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:41:56.323 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-08-25T09:41:56.324 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-08-25T09:41:56.333 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2023-08-25T09:41:56.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.360+0000 7ff27e90f640 1 Processor -- start 2023-08-25T09:41:56.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.360+0000 7ff27e90f640 1 -- start start 2023-08-25T09:41:56.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27e90f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff278152b60 0x7ff2781521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27e90f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff278152f40 0x7ff278071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27e90f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff27806b410 0x7ff278069a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27e90f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27806a3a0 con 0x7ff278152b60 2023-08-25T09:41:56.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27e90f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780b7490 con 0x7ff27806b410 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27e90f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780b6f60 con 0x7ff278152f40 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff278152b60 0x7ff2781521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff278152b60 0x7ff2781521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33390/0 (socket says 172.21.15.89:33390) 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 -- 172.21.15.89:0/647343428 learned_addr learned my addr 172.21.15.89:0/647343428 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff2777fe640 1 --2- 172.21.15.89:0/647343428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff278152f40 0x7ff278071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27ceac640 1 --2- 172.21.15.89:0/647343428 >> v2:172.21.15.121:3300/0 conn(0x7ff27806b410 0x7ff278069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 -- 172.21.15.89:0/647343428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff278152f40 msgr2=0x7ff278071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:56.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 --2- 172.21.15.89:0/647343428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff278152f40 0x7ff278071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 -- 172.21.15.89:0/647343428 >> v2:172.21.15.121:3300/0 conn(0x7ff27806b410 msgr2=0x7ff278069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:56.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 --2- 172.21.15.89:0/647343428 >> v2:172.21.15.121:3300/0 conn(0x7ff27806b410 0x7ff278069a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff277fff640 1 -- 172.21.15.89:0/647343428 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780701e0 con 0x7ff278152b60 2023-08-25T09:41:56.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.361+0000 7ff27ceac640 1 --2- 172.21.15.89:0/647343428 >> v2:172.21.15.121:3300/0 conn(0x7ff27806b410 0x7ff278069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:56.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.362+0000 7ff277fff640 1 --2- 172.21.15.89:0/647343428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2781521d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2780b6a60 tx=0x7ff26802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6838a13f1e8838 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.362+0000 7ff276ffd640 1 -- 172.21.15.89:0/647343428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268031870 con 0x7ff278152b60 2023-08-25T09:41:56.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.362+0000 7ff276ffd640 1 -- 172.21.15.89:0/647343428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2680319d0 con 0x7ff278152b60 2023-08-25T09:41:56.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.362+0000 7ff276ffd640 1 -- 172.21.15.89:0/647343428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268031d60 con 0x7ff278152b60 2023-08-25T09:41:56.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 -- 172.21.15.89:0/647343428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 msgr2=0x7ff2781521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 --2- 172.21.15.89:0/647343428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2781521d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2780b6a60 tx=0x7ff26802b910 comp rx=0 tx=0).stop 2023-08-25T09:41:56.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 -- 172.21.15.89:0/647343428 shutdown_connections 2023-08-25T09:41:56.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 --2- 172.21.15.89:0/647343428 >> v2:172.21.15.121:3300/0 conn(0x7ff27806b410 0x7ff278069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 --2- 172.21.15.89:0/647343428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff278152f40 0x7ff278071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 --2- 172.21.15.89:0/647343428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2781521d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 -- 172.21.15.89:0/647343428 >> 172.21.15.89:0/647343428 conn(0x7ff2780bcfc0 msgr2=0x7ff2780bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 -- 172.21.15.89:0/647343428 shutdown_connections 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.363+0000 7ff27e90f640 1 -- 172.21.15.89:0/647343428 wait complete. 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.364+0000 7ff27e90f640 1 Processor -- start 2023-08-25T09:41:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.364+0000 7ff27e90f640 1 -- start start 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.364+0000 7ff27e90f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff27806b410 0x7ff27814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2780b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff278152f40 0x7ff2781e3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780b5b80 con 0x7ff278152b60 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780aa2b0 con 0x7ff278152f40 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780aa550 con 0x7ff27806b410 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2780b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2780b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33406/0 (socket says 172.21.15.89:33406) 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 -- 172.21.15.89:0/1994419767 learned_addr learned my addr 172.21.15.89:0/1994419767 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff277fff640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff27806b410 0x7ff27814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27ceac640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff278152f40 0x7ff2781e3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 -- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff27806b410 msgr2=0x7ff27814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff27806b410 0x7ff27814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 -- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff278152f40 msgr2=0x7ff2781e3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff278152f40 0x7ff2781e3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 -- 172.21.15.89:0/1994419767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680094d0 con 0x7ff278152b60 2023-08-25T09:41:56.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff2777fe640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2780b5640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c7f0 tx=0x7ff26c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004220 con 0x7ff278152b60 2023-08-25T09:41:56.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c004380 con 0x7ff278152b60 2023-08-25T09:41:56.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2780aa830 con 0x7ff278152b60 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c007840 con 0x7ff278152b60 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.365+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780b5d50 con 0x7ff278152b60 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.366+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff278066c50 con 0x7ff278152b60 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.367+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff26c007bb0 con 0x7ff278152b60 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.367+0000 7ff274ff9640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff26406a080 0x7ff26406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.367+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff26c0881c0 con 0x7ff278152b60 2023-08-25T09:41:56.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.367+0000 7ff277fff640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff26406a080 0x7ff26406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.367+0000 7ff277fff640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff26406a080 0x7ff26406c540 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff268036000 tx=0x7ff26803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.371+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff26c053b70 con 0x7ff278152b60 2023-08-25T09:41:56.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.548+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2780b7ad0 con 0x7ff278152b60 2023-08-25T09:41:56.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.549+0000 7ff274ff9640 1 -- 172.21.15.89:0/1994419767 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14649 (secure 0 0 0) 0x7ff26c01e090 con 0x7ff278152b60 2023-08-25T09:41:56.551 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:56.552 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:41:56.218574+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:41:56.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff26406a080 msgr2=0x7ff26406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff26406a080 0x7ff26406c540 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff268036000 tx=0x7ff26803c040 comp rx=0 tx=0).stop 2023-08-25T09:41:56.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 msgr2=0x7ff2780b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2780b5640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c7f0 tx=0x7ff26c00ccb0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 shutdown_connections 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff26406a080 0x7ff26406c540 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff278152b60 0x7ff2780b5640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff278152f40 0x7ff2781e3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 --2- 172.21.15.89:0/1994419767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff27806b410 0x7ff27814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 >> 172.21.15.89:0/1994419767 conn(0x7ff2780bcfc0 msgr2=0x7ff278152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 shutdown_connections 2023-08-25T09:41:56.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.551+0000 7ff27e90f640 1 -- 172.21.15.89:0/1994419767 wait complete. 2023-08-25T09:41:56.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:41:56.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:41:56.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.664+0000 7fa0abaa7640 1 Processor -- start 2023-08-25T09:41:56.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.664+0000 7fa0abaa7640 1 -- start start 2023-08-25T09:41:56.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0abaa7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a40b68d0 0x7fa0a406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0abaa7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0a40715a0 0x7fa0a4069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0abaa7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40b6cb0 con 0x7fa0a414a970 2023-08-25T09:41:56.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0abaa7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a414ae50 con 0x7fa0a40715a0 2023-08-25T09:41:56.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0abaa7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a414b130 con 0x7fa0a40b68d0 2023-08-25T09:41:56.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0aa044640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa0a414a970 0x7fa0a40b9a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33152/0 (socket says 172.21.15.89:33152) 2023-08-25T09:41:56.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0aa044640 1 -- 172.21.15.89:0/469408078 learned_addr learned my addr 172.21.15.89:0/469408078 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:56.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a9843640 1 --2- 172.21.15.89:0/469408078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a40b68d0 0x7fa0a406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a9042640 1 --2- 172.21.15.89:0/469408078 >> v2:172.21.15.121:3300/0 conn(0x7fa0a40715a0 0x7fa0a4069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a8841640 1 -- 172.21.15.89:0/469408078 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638195314 0 0) 0x7fa0a40b6cb0 con 0x7fa0a414a970 2023-08-25T09:41:56.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a8841640 1 -- 172.21.15.89:0/469408078 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa090003520 con 0x7fa0a414a970 2023-08-25T09:41:56.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a9843640 1 -- 172.21.15.89:0/469408078 >> v2:172.21.15.121:3300/0 conn(0x7fa0a40715a0 msgr2=0x7fa0a4069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:56.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a9843640 1 --2- 172.21.15.89:0/469408078 >> v2:172.21.15.121:3300/0 conn(0x7fa0a40715a0 0x7fa0a4069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a9843640 1 -- 172.21.15.89:0/469408078 >> v1:172.21.15.89:6789/0 conn(0x7fa0a414a970 legacy=0x7fa0a40b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.665+0000 7fa0a9843640 1 -- 172.21.15.89:0/469408078 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a414b410 con 0x7fa0a40b68d0 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.666+0000 7fa0a9843640 1 --2- 172.21.15.89:0/469408078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a40b68d0 0x7fa0a406fd00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00097a0 tx=0x7fa0a002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe4d989337a5bbe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.666+0000 7fa0a8841640 1 -- 172.21.15.89:0/469408078 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0031830 con 0x7fa0a40b68d0 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.666+0000 7fa0a8841640 1 -- 172.21.15.89:0/469408078 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0031990 con 0x7fa0a40b68d0 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.666+0000 7fa0a8841640 1 -- 172.21.15.89:0/469408078 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0031d00 con 0x7fa0a40b68d0 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 -- 172.21.15.89:0/469408078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a40b68d0 msgr2=0x7fa0a406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/469408078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a40b68d0 0x7fa0a406fd00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00097a0 tx=0x7fa0a002b8d0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 -- 172.21.15.89:0/469408078 shutdown_connections 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/469408078 >> v2:172.21.15.121:3300/0 conn(0x7fa0a40715a0 0x7fa0a4069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/469408078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a40b68d0 0x7fa0a406fd00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 -- 172.21.15.89:0/469408078 >> 172.21.15.89:0/469408078 conn(0x7fa0a406d350 msgr2=0x7fa0a406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 -- 172.21.15.89:0/469408078 shutdown_connections 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.667+0000 7fa0abaa7640 1 -- 172.21.15.89:0/469408078 wait complete. 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.668+0000 7fa0abaa7640 1 Processor -- start 2023-08-25T09:41:56.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.668+0000 7fa0abaa7640 1 -- start start 2023-08-25T09:41:56.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0a40715a0 0x7fa0a4141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 0x7fa0a4141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a414a970 0x7fa0a41422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4141580 con 0x7fa0a40b68d0 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a41e32e0 con 0x7fa0a40715a0 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a41e35c0 con 0x7fa0a414a970 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 0x7fa0a4141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 0x7fa0a4141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33422/0 (socket says 172.21.15.89:33422) 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 -- 172.21.15.89:0/2566827291 learned_addr learned my addr 172.21.15.89:0/2566827291 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9843640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0a40715a0 0x7fa0a4141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0aa044640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a414a970 0x7fa0a41422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 -- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a414a970 msgr2=0x7fa0a41422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a414a970 0x7fa0a41422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 -- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0a40715a0 msgr2=0x7fa0a4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0a40715a0 0x7fa0a4141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 -- 172.21.15.89:0/2566827291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009400 con 0x7fa0a40b68d0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9843640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0a40715a0 0x7fa0a4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0a9042640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 0x7fa0a4141db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d5f0 tx=0x7fa09400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940125f0 con 0x7fa0a40b68d0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094012750 con 0x7fa0a40b68d0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094012b00 con 0x7fa0a40b68d0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a41e38a0 con 0x7fa0a40b68d0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.669+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a40b6260 con 0x7fa0a40b68d0 2023-08-25T09:41:56.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.670+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a406fea0 con 0x7fa0a40b68d0 2023-08-25T09:41:56.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.671+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa094012c60 con 0x7fa0a40b68d0 2023-08-25T09:41:56.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.671+0000 7fa09a7fc640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa08806a050 0x7fa08806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.671+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa0940886d0 con 0x7fa0a40b68d0 2023-08-25T09:41:56.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.671+0000 7fa0a9843640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa08806a050 0x7fa08806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.672+0000 7fa0a9843640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa08806a050 0x7fa08806c510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0036000 tx=0x7fa0a0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.675+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa094054110 con 0x7fa0a40b68d0 2023-08-25T09:41:56.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.840+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0a404dc40 con 0x7fa0a40b68d0 2023-08-25T09:41:56.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.841+0000 7fa09a7fc640 1 -- 172.21.15.89:0/2566827291 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa094057730 con 0x7fa0a40b68d0 2023-08-25T09:41:56.843 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:41:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa08806a050 msgr2=0x7fa08806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa08806a050 0x7fa08806c510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0036000 tx=0x7fa0a0008030 comp rx=0 tx=0).stop 2023-08-25T09:41:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 msgr2=0x7fa0a4141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 0x7fa0a4141db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d5f0 tx=0x7fa09400dab0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 shutdown_connections 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa08806a050 0x7fa08806c510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0a40b68d0 0x7fa0a4141db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0a414a970 0x7fa0a41422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 --2- 172.21.15.89:0/2566827291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0a40715a0 0x7fa0a4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 >> 172.21.15.89:0/2566827291 conn(0x7fa0a406d350 msgr2=0x7fa0a40b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:56.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 shutdown_connections 2023-08-25T09:41:56.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.843+0000 7fa0abaa7640 1 -- 172.21.15.89:0/2566827291 wait complete. 2023-08-25T09:41:56.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:41:56.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.955+0000 7fec68694640 1 Processor -- start 2023-08-25T09:41:56.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.955+0000 7fec68694640 1 -- start start 2023-08-25T09:41:56.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec68694640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec60144980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec68694640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec600ba300 con 0x7fec6014a9a0 2023-08-25T09:41:56.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec68694640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec60144ec0 con 0x7fec600bcf70 2023-08-25T09:41:56.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec68694640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec600b9640 con 0x7fec60144560 2023-08-25T09:41:56.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec66c31640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fec6014a9a0 0x7fec6014adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33166/0 (socket says 172.21.15.89:33166) 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec66c31640 1 -- 172.21.15.89:0/611852445 learned_addr learned my addr 172.21.15.89:0/611852445 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec65c2f640 1 --2- 172.21.15.89:0/611852445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec60144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec6542e640 1 -- 172.21.15.89:0/611852445 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687437900 0 0) 0x7fec600ba300 con 0x7fec6014a9a0 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec6542e640 1 -- 172.21.15.89:0/611852445 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec4c003520 con 0x7fec6014a9a0 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec6542e640 1 -- 172.21.15.89:0/611852445 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464413589 0 0) 0x7fec60144ec0 con 0x7fec600bcf70 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec65c2f640 1 -- 172.21.15.89:0/611852445 >> v1:172.21.15.121:6789/0 conn(0x7fec600bcf70 legacy=0x7fec600bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec65c2f640 1 -- 172.21.15.89:0/611852445 >> v1:172.21.15.89:6789/0 conn(0x7fec6014a9a0 legacy=0x7fec6014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.956+0000 7fec65c2f640 1 -- 172.21.15.89:0/611852445 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600b8a60 con 0x7fec60144560 2023-08-25T09:41:56.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.957+0000 7fec65c2f640 1 --2- 172.21.15.89:0/611852445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec60144980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec500097d0 tx=0x7fec5002b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e50fed995d33b652 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.957+0000 7fec6542e640 1 -- 172.21.15.89:0/611852445 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580019f0 con 0x7fec60144560 2023-08-25T09:41:56.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.957+0000 7fec6542e640 1 -- 172.21.15.89:0/611852445 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5002e050 con 0x7fec60144560 2023-08-25T09:41:56.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.957+0000 7fec6542e640 1 -- 172.21.15.89:0/611852445 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50030710 con 0x7fec60144560 2023-08-25T09:41:56.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 -- 172.21.15.89:0/611852445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 msgr2=0x7fec60144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 --2- 172.21.15.89:0/611852445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec60144980 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec500097d0 tx=0x7fec5002b730 comp rx=0 tx=0).stop 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 -- 172.21.15.89:0/611852445 shutdown_connections 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 --2- 172.21.15.89:0/611852445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec60144980 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 -- 172.21.15.89:0/611852445 >> 172.21.15.89:0/611852445 conn(0x7fec600654f0 msgr2=0x7fec600658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 -- 172.21.15.89:0/611852445 shutdown_connections 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.958+0000 7fec68694640 1 -- 172.21.15.89:0/611852445 wait complete. 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.959+0000 7fec68694640 1 Processor -- start 2023-08-25T09:41:56.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.959+0000 7fec68694640 1 -- start start 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.959+0000 7fec68694640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600bcf70 0x7fec600b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.959+0000 7fec68694640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec601dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.959+0000 7fec68694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 0x7fec600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec68694640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600bcb40 con 0x7fec6014a9a0 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec68694640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600b4860 con 0x7fec600bcf70 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec68694640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6014d630 con 0x7fec60144560 2023-08-25T09:41:56.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 0x7fec600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 0x7fec600a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33432/0 (socket says 172.21.15.89:33432) 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 -- 172.21.15.89:0/2709199534 learned_addr learned my addr 172.21.15.89:0/2709199534 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec65c2f640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec601dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66430640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600bcf70 0x7fec600b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 -- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 msgr2=0x7fec601dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec601dffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 -- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600bcf70 msgr2=0x7fec600b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:56.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600bcf70 0x7fec600b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 -- 172.21.15.89:0/2709199534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50009400 con 0x7fec6014a9a0 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec66c31640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 0x7fec600a5870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec5800caa0 tx=0x7fec5800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5800a9f0 con 0x7fec6014a9a0 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5800ab50 con 0x7fec6014a9a0 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec600b6b20 con 0x7fec6014a9a0 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58004e30 con 0x7fec6014a9a0 2023-08-25T09:41:56.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.960+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec601dfb20 con 0x7fec6014a9a0 2023-08-25T09:41:56.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.961+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec601dfcb0 con 0x7fec6014a9a0 2023-08-25T09:41:56.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.962+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec580070d0 con 0x7fec6014a9a0 2023-08-25T09:41:56.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.962+0000 7fec56ffd640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fec4406a050 0x7fec4406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:56.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.962+0000 7fec66430640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fec4406a050 0x7fec4406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:56.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.962+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fec58087c90 con 0x7fec6014a9a0 2023-08-25T09:41:56.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.963+0000 7fec66430640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fec4406a050 0x7fec4406c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000f60 tx=0x7fec5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:56.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:56.966+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fec58053760 con 0x7fec6014a9a0 2023-08-25T09:41:57.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.133+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec6004dc40 con 0x7fec6014a9a0 2023-08-25T09:41:57.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.133+0000 7fec56ffd640 1 -- 172.21.15.89:0/2709199534 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec580180a0 con 0x7fec6014a9a0 2023-08-25T09:41:57.135 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:41:57.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fec4406a050 msgr2=0x7fec4406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fec4406a050 0x7fec4406c510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000f60 tx=0x7fec5c009040 comp rx=0 tx=0).stop 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 msgr2=0x7fec600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 0x7fec600a5870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec5800caa0 tx=0x7fec5800cf60 comp rx=0 tx=0).stop 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 shutdown_connections 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fec4406a050 0x7fec4406c510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec6014a9a0 0x7fec600a5870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec60144560 0x7fec601dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 --2- 172.21.15.89:0/2709199534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600bcf70 0x7fec600b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 >> 172.21.15.89:0/2709199534 conn(0x7fec600654f0 msgr2=0x7fec600bc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:57.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 shutdown_connections 2023-08-25T09:41:57.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.135+0000 7fec68694640 1 -- 172.21.15.89:0/2709199534 wait complete. 2023-08-25T09:41:57.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:41:57.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.245+0000 7fd720dc9640 1 Processor -- start 2023-08-25T09:41:57.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.245+0000 7fd720dc9640 1 -- start start 2023-08-25T09:41:57.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd720dc9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd71c0b9c80 0x7fd71c06f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd720dc9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c071080 con 0x7fd71c14a8b0 2023-08-25T09:41:57.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd720dc9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0b6de0 con 0x7fd71c153150 2023-08-25T09:41:57.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd720dc9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c0b8190 con 0x7fd71c0b9c80 2023-08-25T09:41:57.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd719d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd71c14a8b0 0x7fd71c0b66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33170/0 (socket says 172.21.15.89:33170) 2023-08-25T09:41:57.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd719d9b640 1 -- 172.21.15.89:0/817161249 learned_addr learned my addr 172.21.15.89:0/817161249 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:57.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd71a59c640 1 --2- 172.21.15.89:0/817161249 >> v2:172.21.15.121:3300/0 conn(0x7fd71c0b9c80 0x7fd71c06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093250960 0 0) 0x7fd71c071080 con 0x7fd71c14a8b0 2023-08-25T09:41:57.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.246+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003520 con 0x7fd71c14a8b0 2023-08-25T09:41:57.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290384875 0 0) 0x7fd704003520 con 0x7fd71c14a8b0 2023-08-25T09:41:57.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 >> v2:172.21.15.121:3300/0 conn(0x7fd71c0b9c80 msgr2=0x7fd71c06f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 --2- 172.21.15.89:0/817161249 >> v2:172.21.15.121:3300/0 conn(0x7fd71c0b9c80 0x7fd71c06f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 >> v1:172.21.15.121:6789/0 conn(0x7fd71c153150 legacy=0x7fd71c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c06fe70 con 0x7fd71c14a8b0 2023-08-25T09:41:57.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fd710001670 con 0x7fd71c14a8b0 2023-08-25T09:41:57.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 >> v1:172.21.15.89:6789/0 conn(0x7fd71c14a8b0 legacy=0x7fd71c0b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd704003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7040047c0 0x7fd704004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd704005180 0x7fd70400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0b8190 con 0x7fd7040039e0 2023-08-25T09:41:57.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400c090 con 0x7fd704005180 2023-08-25T09:41:57.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400c250 con 0x7fd7040047c0 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71a59c640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd704003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd719d9b640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7040047c0 0x7fd704004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71ad9d640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd704005180 0x7fd70400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71a59c640 1 -- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7040047c0 msgr2=0x7fd704004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71a59c640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7040047c0 0x7fd704004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71a59c640 1 -- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd704005180 msgr2=0x7fd70400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71a59c640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd704005180 0x7fd70400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71ad9d640 1 -- 172.21.15.89:0/817161249 reap_dead start 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.247+0000 7fd71a59c640 1 -- 172.21.15.89:0/817161249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704003520 con 0x7fd7040039e0 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd71a59c640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd704003e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ac0 tx=0x7fd7040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d038a1ceab2ed743 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c02c6b0 con 0x7fd7040039e0 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c02c810 con 0x7fd7040039e0 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd71959a640 1 -- 172.21.15.89:0/817161249 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c02cba0 con 0x7fd7040039e0 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd720dc9640 1 -- 172.21.15.89:0/817161249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 msgr2=0x7fd704003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd720dc9640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd704003e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ac0 tx=0x7fd7040057f0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.248+0000 7fd720dc9640 1 -- 172.21.15.89:0/817161249 shutdown_connections 2023-08-25T09:41:57.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.249+0000 7fd720dc9640 1 --2- 172.21.15.89:0/817161249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd704003e00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.249+0000 7fd720dc9640 1 -- 172.21.15.89:0/817161249 >> 172.21.15.89:0/817161249 conn(0x7fd71c0bcfa0 msgr2=0x7fd71c0bd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:57.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.249+0000 7fd720dc9640 1 -- 172.21.15.89:0/817161249 shutdown_connections 2023-08-25T09:41:57.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.249+0000 7fd720dc9640 1 -- 172.21.15.89:0/817161249 wait complete. 2023-08-25T09:41:57.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 Processor -- start 2023-08-25T09:41:57.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 -- start start 2023-08-25T09:41:57.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd71c0b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd71c145d10 0x7fd71c13bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd71c06ae30 0x7fd71c1e4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0b64c0 con 0x7fd7040039e0 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c1e04a0 con 0x7fd71c145d10 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd720dc9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0b5f00 con 0x7fd71c06ae30 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd71a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd71c0b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd71a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd71c0b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33450/0 (socket says 172.21.15.89:33450) 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.250+0000 7fd71a59c640 1 -- 172.21.15.89:0/697352648 learned_addr learned my addr 172.21.15.89:0/697352648 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71ad9d640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd71c06ae30 0x7fd71c1e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71a59c640 1 -- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd71c06ae30 msgr2=0x7fd71c1e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71a59c640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd71c06ae30 0x7fd71c1e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd719d9b640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd71c145d10 0x7fd71c13bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71a59c640 1 -- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd71c145d10 msgr2=0x7fd71c13bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71a59c640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd71c145d10 0x7fd71c13bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71a59c640 1 -- 172.21.15.89:0/697352648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0b61e0 con 0x7fd7040039e0 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71ad9d640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd71c06ae30 0x7fd71c1e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd71a59c640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd71c0b58e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ac0 tx=0x7fd70c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c003810 con 0x7fd7040039e0 2023-08-25T09:41:57.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c003970 con 0x7fd7040039e0 2023-08-25T09:41:57.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c1e3b40 con 0x7fd7040039e0 2023-08-25T09:41:57.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c003d00 con 0x7fd7040039e0 2023-08-25T09:41:57.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.251+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c1417b0 con 0x7fd7040039e0 2023-08-25T09:41:57.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.252+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c1419a0 con 0x7fd7040039e0 2023-08-25T09:41:57.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.252+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd70c040450 con 0x7fd7040039e0 2023-08-25T09:41:57.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.253+0000 7fd70affd640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd6fc06a080 0x7fd6fc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.253+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd70c0aa120 con 0x7fd7040039e0 2023-08-25T09:41:57.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.253+0000 7fd719d9b640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd6fc06a080 0x7fd6fc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.253+0000 7fd719d9b640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd6fc06a080 0x7fd6fc06c540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd710001050 tx=0x7fd710009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.257+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd70c075b60 con 0x7fd7040039e0 2023-08-25T09:41:57.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.463+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd71c1e39a0 con 0x7fd7040039e0 2023-08-25T09:41:57.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.464+0000 7fd70affd640 1 -- 172.21.15.89:0/697352648 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fd71c1e39a0 con 0x7fd7040039e0 2023-08-25T09:41:57.467 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:57.467 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-25T09:41:57.468 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 3 2023-08-25T09:41:57.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd6fc06a080 msgr2=0x7fd6fc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd6fc06a080 0x7fd6fc06c540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd710001050 tx=0x7fd710009040 comp rx=0 tx=0).stop 2023-08-25T09:41:57.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 msgr2=0x7fd71c0b58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd71c0b58e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ac0 tx=0x7fd70c004730 comp rx=0 tx=0).stop 2023-08-25T09:41:57.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 shutdown_connections 2023-08-25T09:41:57.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd6fc06a080 0x7fd6fc06c540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd71c06ae30 0x7fd71c1e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd71c145d10 0x7fd71c13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 --2- 172.21.15.89:0/697352648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7040039e0 0x7fd71c0b58e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 >> 172.21.15.89:0/697352648 conn(0x7fd71c0bcfa0 msgr2=0x7fd71c149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 shutdown_connections 2023-08-25T09:41:57.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.466+0000 7fd720dc9640 1 -- 172.21.15.89:0/697352648 wait complete. 2023-08-25T09:41:57.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:41:57.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.580+0000 7f2a59d6b640 1 Processor -- start 2023-08-25T09:41:57.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.580+0000 7f2a59d6b640 1 -- start start 2023-08-25T09:41:57.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.581+0000 7f2a59d6b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 0x7f2a540b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.581+0000 7f2a59d6b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a54149010 con 0x7f2a5406eba0 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.581+0000 7f2a59d6b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a541489c0 con 0x7f2a541494a0 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.581+0000 7f2a59d6b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b52e0 con 0x7f2a5406ef80 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.581+0000 7f2a537fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2a5406eba0 0x7f2a5406d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33182/0 (socket says 172.21.15.89:33182) 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.581+0000 7f2a537fe640 1 -- 172.21.15.89:0/2577574736 learned_addr learned my addr 172.21.15.89:0/2577574736 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386817206 0 0) 0x7f2a54149010 con 0x7f2a5406eba0 2023-08-25T09:41:57.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c003520 con 0x7f2a5406eba0 2023-08-25T09:41:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a53fff640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 0x7f2a540b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4203412825 0 0) 0x7f2a3c003520 con 0x7f2a5406eba0 2023-08-25T09:41:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 msgr2=0x7f2a540b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 0x7f2a540b9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 >> v1:172.21.15.121:6789/0 conn(0x7f2a541494a0 legacy=0x7f2a540b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54148ca0 con 0x7f2a5406eba0 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f2a440017f0 con 0x7f2a5406eba0 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 >> v1:172.21.15.89:6789/0 conn(0x7f2a5406eba0 legacy=0x7f2a5406d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c003a10 0x7f2a3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a3c0047c0 0x7f2a3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 0x7f2a3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b52e0 con 0x7f2a3c003a10 2023-08-25T09:41:57.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c00ba80 con 0x7f2a3c0047c0 2023-08-25T09:41:57.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c00bc40 con 0x7f2a5406ef80 2023-08-25T09:41:57.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a537fe640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c003a10 0x7f2a3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a52ffd640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a3c0047c0 0x7f2a3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a53fff640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 0x7f2a3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a537fe640 1 -- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 msgr2=0x7f2a3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a537fe640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a5406ef80 0x7f2a3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a537fe640 1 -- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a3c0047c0 msgr2=0x7f2a3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a537fe640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a3c0047c0 0x7f2a3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a537fe640 1 -- 172.21.15.89:0/2577574736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c003520 con 0x7f2a3c003a10 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.582+0000 7f2a52ffd640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a3c0047c0 0x7f2a3c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a537fe640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c003a10 0x7f2a3c003e30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c190 tx=0x7f2a3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961e01ebbfaab7bf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44007270 con 0x7f2a3c003a10 2023-08-25T09:41:57.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440073f0 con 0x7f2a3c003a10 2023-08-25T09:41:57.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a527fc640 1 -- 172.21.15.89:0/2577574736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4402c8a0 con 0x7f2a3c003a10 2023-08-25T09:41:57.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a59d6b640 1 -- 172.21.15.89:0/2577574736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c003a10 msgr2=0x7f2a3c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/2577574736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a3c003a10 0x7f2a3c003e30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c190 tx=0x7f2a3c0057f0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.583+0000 7f2a53fff640 1 -- 172.21.15.89:0/2577574736 reap_dead start 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.584+0000 7f2a59d6b640 1 -- 172.21.15.89:0/2577574736 shutdown_connections 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.584+0000 7f2a59d6b640 1 -- 172.21.15.89:0/2577574736 >> 172.21.15.89:0/2577574736 conn(0x7f2a540be090 msgr2=0x7f2a540be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.584+0000 7f2a59d6b640 1 -- 172.21.15.89:0/2577574736 shutdown_connections 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.584+0000 7f2a59d6b640 1 -- 172.21.15.89:0/2577574736 wait complete. 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 Processor -- start 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 -- start start 2023-08-25T09:41:57.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a3c003a10 0x7f2a54147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 0x7f2a5413a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a541dd4f0 0x7f2a541dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54148150 con 0x7f2a54139e10 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54145b50 con 0x7f2a541dd4f0 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a59d6b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541ddee0 con 0x7f2a3c003a10 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a52ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 0x7f2a5413a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a52ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 0x7f2a5413a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33474/0 (socket says 172.21.15.89:33474) 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.585+0000 7f2a52ffd640 1 -- 172.21.15.89:0/3457967822 learned_addr learned my addr 172.21.15.89:0/3457967822 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a537fe640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a3c003a10 0x7f2a54147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a53fff640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a541dd4f0 0x7f2a541dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a52ffd640 1 -- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a3c003a10 msgr2=0x7f2a54147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a52ffd640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a3c003a10 0x7f2a54147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a52ffd640 1 -- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a541dd4f0 msgr2=0x7f2a541dd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a52ffd640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a541dd4f0 0x7f2a541dd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a52ffd640 1 -- 172.21.15.89:0/3457967822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a541e0cb0 con 0x7f2a54139e10 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a53fff640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a541dd4f0 0x7f2a541dd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a52ffd640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 0x7f2a5413a250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e500 tx=0x7f2a4800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480052e0 con 0x7f2a54139e10 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48005440 con 0x7f2a54139e10 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a541e0f90 con 0x7f2a54139e10 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48003810 con 0x7f2a54139e10 2023-08-25T09:41:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.586+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a541e1550 con 0x7f2a54139e10 2023-08-25T09:41:57.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.587+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a541e1710 con 0x7f2a54139e10 2023-08-25T09:41:57.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.587+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a48003970 con 0x7f2a54139e10 2023-08-25T09:41:57.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.588+0000 7f2a3bfff640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a4006a080 0x7f2a4006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.588+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a48087f00 con 0x7f2a54139e10 2023-08-25T09:41:57.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.588+0000 7f2a537fe640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a4006a080 0x7f2a4006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.588+0000 7f2a537fe640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a4006a080 0x7f2a4006c540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a44034000 tx=0x7f2a44009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.592+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a48053950 con 0x7f2a54139e10 2023-08-25T09:41:57.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.760+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a54066c50 con 0x7f2a54139e10 2023-08-25T09:41:57.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.760+0000 7f2a3bfff640 1 -- 172.21.15.89:0/3457967822 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14636 (secure 0 0 0) 0x7f2a48056f70 con 0x7f2a54139e10 2023-08-25T09:41:57.762 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:57.762 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:41:57.223116+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:41:57.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a4006a080 msgr2=0x7f2a4006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a4006a080 0x7f2a4006c540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a44034000 tx=0x7f2a44009030 comp rx=0 tx=0).stop 2023-08-25T09:41:57.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 msgr2=0x7f2a5413a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 0x7f2a5413a250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e500 tx=0x7f2a4800e9c0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 shutdown_connections 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a4006a080 0x7f2a4006c540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a54139e10 0x7f2a5413a250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a541dd4f0 0x7f2a541dd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 --2- 172.21.15.89:0/3457967822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a3c003a10 0x7f2a54147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 >> 172.21.15.89:0/3457967822 conn(0x7f2a540be090 msgr2=0x7f2a540bc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 shutdown_connections 2023-08-25T09:41:57.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.762+0000 7f2a59d6b640 1 -- 172.21.15.89:0/3457967822 wait complete. 2023-08-25T09:41:57.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:41:57.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:41:57.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.876+0000 7fcfa3e46640 1 Processor -- start 2023-08-25T09:41:57.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.876+0000 7fcfa3e46640 1 -- start start 2023-08-25T09:41:57.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.877+0000 7fcfa3e46640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.877+0000 7fcfa3e46640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcf9c06dd00 0x7fcf9c14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.877+0000 7fcfa3e46640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c142fb0 con 0x7fcf9c06e160 2023-08-25T09:41:57.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.877+0000 7fcfa3e46640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c06f0e0 con 0x7fcf9c06dd00 2023-08-25T09:41:57.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.877+0000 7fcfa3e46640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c06e840 con 0x7fcf9c142bd0 2023-08-25T09:41:57.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa13e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcf9c06dd00 0x7fcf9c14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa1be2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa23e3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcf9c06e160 0x7fcf9c148790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:42090/0 (socket says 172.21.15.89:42090) 2023-08-25T09:41:57.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa23e3640 1 -- 172.21.15.89:0/2201597982 learned_addr learned my addr 172.21.15.89:0/2201597982 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:57.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 msgr2=0x7fcf9c06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:57.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa13e1640 1 --2- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c06d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2201597982 >> v1:172.21.15.121:6789/0 conn(0x7fcf9c06e160 legacy=0x7fcf9c148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2201597982 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c06eb20 con 0x7fcf9c06dd00 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.878+0000 7fcfa1be2640 1 --2- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa13e1640 1 --2- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c14c0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0097a0 tx=0x7fcf8c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c9f355cde76d04 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa0be0640 1 -- 172.21.15.89:0/2201597982 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c030610 con 0x7fcf9c06dd00 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa0be0640 1 -- 172.21.15.89:0/2201597982 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c030770 con 0x7fcf9c06dd00 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa0be0640 1 -- 172.21.15.89:0/2201597982 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c030b00 con 0x7fcf9c06dd00 2023-08-25T09:41:57.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 msgr2=0x7fcf9c14c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c14c0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0097a0 tx=0x7fcf8c02b960 comp rx=0 tx=0).stop 2023-08-25T09:41:57.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2201597982 shutdown_connections 2023-08-25T09:41:57.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c14c0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2201597982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.879+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2201597982 >> 172.21.15.89:0/2201597982 conn(0x7fcf9c0babd0 msgr2=0x7fcf9c0bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:57.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.880+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2201597982 shutdown_connections 2023-08-25T09:41:57.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.880+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2201597982 wait complete. 2023-08-25T09:41:57.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.880+0000 7fcfa3e46640 1 Processor -- start 2023-08-25T09:41:57.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 -- start start 2023-08-25T09:41:57.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 0x7fcf9c1d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c1d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c13ff40 con 0x7fcf9c06e160 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c1d4bb0 con 0x7fcf9c06dd00 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa3e46640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c1d1b20 con 0x7fcf9c142bd0 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa13e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 0x7fcf9c1d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa13e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 0x7fcf9c1d3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33486/0 (socket says 172.21.15.89:33486) 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2098073791 learned_addr learned my addr 172.21.15.89:0/2098073791 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa23e3640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c1d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa1be2640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 msgr2=0x7fcf9c1d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa13e1640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c1d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.881+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 msgr2=0x7fcf9c1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa13e1640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa13e1640 1 -- 172.21.15.89:0/2098073791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009400 con 0x7fcf9c06e160 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa23e3640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c1d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:57.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa1be2640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa13e1640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 0x7fcf9c1d3f70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c02bf70 tx=0x7fcf8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c03e040 con 0x7fcf9c06e160 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c039cb0 con 0x7fcf9c06e160 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c009400 con 0x7fcf9c06e160 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c044630 con 0x7fcf9c06e160 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.882+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c14b440 con 0x7fcf9c06e160 2023-08-25T09:41:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.883+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c1d4d20 con 0x7fcf9c06e160 2023-08-25T09:41:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.883+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf8c04d3b0 con 0x7fcf9c06e160 2023-08-25T09:41:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.884+0000 7fcf927fc640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcf8006a050 0x7fcf8006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.884+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf8c0aa5e0 con 0x7fcf9c06e160 2023-08-25T09:41:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.884+0000 7fcfa1be2640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcf8006a050 0x7fcf8006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.884+0000 7fcfa1be2640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcf8006a050 0x7fcf8006c510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009bb0 tx=0x7fcf98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:57.888+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf8c075f90 con 0x7fcf9c06e160 2023-08-25T09:41:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.054+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf9c04dc40 con 0x7fcf9c06e160 2023-08-25T09:41:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.054+0000 7fcf927fc640 1 -- 172.21.15.89:0/2098073791 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf8c0795b0 con 0x7fcf9c06e160 2023-08-25T09:41:58.058 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.056+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcf8006a050 msgr2=0x7fcf8006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.056+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcf8006a050 0x7fcf8006c510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009bb0 tx=0x7fcf98008040 comp rx=0 tx=0).stop 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.056+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 msgr2=0x7fcf9c1d3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.056+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 0x7fcf9c1d3f70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c02bf70 tx=0x7fcf8c004730 comp rx=0 tx=0).stop 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.056+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 shutdown_connections 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcf8006a050 0x7fcf8006c510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf9c06e160 0x7fcf9c1d3f70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf9c142bd0 0x7fcf9c1d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 --2- 172.21.15.89:0/2098073791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf9c06dd00 0x7fcf9c1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 >> 172.21.15.89:0/2098073791 conn(0x7fcf9c0babd0 msgr2=0x7fcf9c0bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 shutdown_connections 2023-08-25T09:41:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.057+0000 7fcfa3e46640 1 -- 172.21.15.89:0/2098073791 wait complete. 2023-08-25T09:41:58.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:41:58.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.170+0000 7f84423e3640 1 Processor -- start 2023-08-25T09:41:58.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.170+0000 7f84423e3640 1 -- start start 2023-08-25T09:41:58.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f84423e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f843c0b6a50 0x7f843c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f84423e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b9100 0x7f843c14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f84423e3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f843c14b130 0x7f843c14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f84423e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c070b70 con 0x7f843c0b6a50 2023-08-25T09:41:58.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f84423e3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c070240 con 0x7f843c14b130 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f84423e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c070520 con 0x7f843c0b9100 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f843c0b6a50 0x7f843c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f843c0b6a50 0x7f843c06f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33500/0 (socket says 172.21.15.89:33500) 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 -- 172.21.15.89:0/1850759875 learned_addr learned my addr 172.21.15.89:0/1850759875 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 -- 172.21.15.89:0/1850759875 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b9100 msgr2=0x7f843c14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 --2- 172.21.15.89:0/1850759875 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b9100 0x7f843c14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 -- 172.21.15.89:0/1850759875 >> v2:172.21.15.121:3300/0 conn(0x7f843c14b130 msgr2=0x7f843c14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f8440980640 1 --2- 172.21.15.89:0/1850759875 >> v2:172.21.15.121:3300/0 conn(0x7f843c14b130 0x7f843c14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 --2- 172.21.15.89:0/1850759875 >> v2:172.21.15.121:3300/0 conn(0x7f843c14b130 0x7f843c14b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.171+0000 7f843bfff640 1 -- 172.21.15.89:0/1850759875 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c070800 con 0x7f843c0b6a50 2023-08-25T09:41:58.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f843bfff640 1 --2- 172.21.15.89:0/1850759875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c0b6a50 0x7f843c06f9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f843c066530 tx=0x7f842c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0f5468caa195c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f843affd640 1 -- 172.21.15.89:0/1850759875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c036440 con 0x7f843c0b6a50 2023-08-25T09:41:58.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f843affd640 1 -- 172.21.15.89:0/1850759875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c0365a0 con 0x7f843c0b6a50 2023-08-25T09:41:58.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f843affd640 1 -- 172.21.15.89:0/1850759875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c036930 con 0x7f843c0b6a50 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 -- 172.21.15.89:0/1850759875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c0b6a50 msgr2=0x7f843c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 --2- 172.21.15.89:0/1850759875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c0b6a50 0x7f843c06f9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f843c066530 tx=0x7f842c02e170 comp rx=0 tx=0).stop 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 -- 172.21.15.89:0/1850759875 shutdown_connections 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 --2- 172.21.15.89:0/1850759875 >> v2:172.21.15.121:3300/0 conn(0x7f843c14b130 0x7f843c14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 --2- 172.21.15.89:0/1850759875 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b9100 0x7f843c14abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 --2- 172.21.15.89:0/1850759875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c0b6a50 0x7f843c06f9e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.172+0000 7f84423e3640 1 -- 172.21.15.89:0/1850759875 >> 172.21.15.89:0/1850759875 conn(0x7f843c06d350 msgr2=0x7f843c06d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.173+0000 7f84423e3640 1 -- 172.21.15.89:0/1850759875 shutdown_connections 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.173+0000 7f84423e3640 1 -- 172.21.15.89:0/1850759875 wait complete. 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.173+0000 7f84423e3640 1 Processor -- start 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 -- start start 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b6a50 0x7f843c06a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f843c0b9100 0x7f843c1dc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 0x7f843c149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c149980 con 0x7f843c14b130 2023-08-25T09:41:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c137ed0 con 0x7f843c0b9100 2023-08-25T09:41:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f84423e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c1dbc10 con 0x7f843c0b6a50 2023-08-25T09:41:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f8440980640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 0x7f843c149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f8440980640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 0x7f843c149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33502/0 (socket says 172.21.15.89:33502) 2023-08-25T09:41:58.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.174+0000 7f8440980640 1 -- 172.21.15.89:0/689201782 learned_addr learned my addr 172.21.15.89:0/689201782 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f843b7fe640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f843c0b9100 0x7f843c1dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f843bfff640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b6a50 0x7f843c06a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8440980640 1 -- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b6a50 msgr2=0x7f843c06a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8440980640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b6a50 0x7f843c06a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8440980640 1 -- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f843c0b9100 msgr2=0x7f843c1dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8440980640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f843c0b9100 0x7f843c1dc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8440980640 1 -- 172.21.15.89:0/689201782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c00b770 con 0x7f843c14b130 2023-08-25T09:41:58.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8440980640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 0x7f843c149440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f843400cc30 tx=0x7f843400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843400ce40 con 0x7f843c14b130 2023-08-25T09:41:58.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8434003990 con 0x7f843c14b130 2023-08-25T09:41:58.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c071180 con 0x7f843c14b130 2023-08-25T09:41:58.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434003d20 con 0x7f843c14b130 2023-08-25T09:41:58.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.175+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c1dbe60 con 0x7f843c14b130 2023-08-25T09:41:58.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.176+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c070fe0 con 0x7f843c14b130 2023-08-25T09:41:58.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.176+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8434003e80 con 0x7f843c14b130 2023-08-25T09:41:58.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.177+0000 7f8438ff9640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f841c06a080 0x7f841c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.177+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f84340885a0 con 0x7f843c14b130 2023-08-25T09:41:58.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.177+0000 7f843bfff640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f841c06a080 0x7f841c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.177+0000 7f843bfff640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f841c06a080 0x7f841c06c540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f842c038000 tx=0x7f842c032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.181+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f843c070fe0 con 0x7f843c14b130 2023-08-25T09:41:58.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.349+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f843c070fe0 con 0x7f843c14b130 2023-08-25T09:41:58.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.349+0000 7f8438ff9640 1 -- 172.21.15.89:0/689201782 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f843c070fe0 con 0x7f843c14b130 2023-08-25T09:41:58.351 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:41:58.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f841c06a080 msgr2=0x7f841c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f841c06a080 0x7f841c06c540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f842c038000 tx=0x7f842c032000 comp rx=0 tx=0).stop 2023-08-25T09:41:58.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 msgr2=0x7f843c149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 0x7f843c149440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f843400cc30 tx=0x7f843400a5c0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 shutdown_connections 2023-08-25T09:41:58.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f841c06a080 0x7f841c06c540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f843c14b130 0x7f843c149440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f843c0b9100 0x7f843c1dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 --2- 172.21.15.89:0/689201782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f843c0b6a50 0x7f843c06a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 >> 172.21.15.89:0/689201782 conn(0x7f843c06d350 msgr2=0x7f843c13f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:58.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 shutdown_connections 2023-08-25T09:41:58.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.351+0000 7f84423e3640 1 -- 172.21.15.89:0/689201782 wait complete. 2023-08-25T09:41:58.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T09:41:58.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.461+0000 7fd394b2f640 1 Processor -- start 2023-08-25T09:41:58.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.461+0000 7fd394b2f640 1 -- start start 2023-08-25T09:41:58.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd394b2f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3900b7c10 0x7fd390070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd394b2f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd390070fd0 0x7fd390141650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd394b2f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3900b3040 con 0x7fd39006fb00 2023-08-25T09:41:58.464 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd394b2f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900b27a0 con 0x7fd3900b7c10 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd394b2f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b2a80 con 0x7fd390070fd0 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3900b7c10 0x7fd390070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3900b7c10 0x7fd390070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33516/0 (socket says 172.21.15.89:33516) 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 -- 172.21.15.89:0/1142470664 learned_addr learned my addr 172.21.15.89:0/1142470664 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38dd9b640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd390070fd0 0x7fd390141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 -- 172.21.15.89:0/1142470664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd390070fd0 msgr2=0x7fd390141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd390070fd0 0x7fd390141650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 -- 172.21.15.89:0/1142470664 >> v1:172.21.15.121:6789/0 conn(0x7fd39006fb00 legacy=0x7fd3900b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38e59c640 1 -- 172.21.15.89:0/1142470664 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900b2d60 con 0x7fd3900b7c10 2023-08-25T09:41:58.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.462+0000 7fd38dd9b640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd390070fd0 0x7fd390141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:58.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.463+0000 7fd38e59c640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3900b7c10 0x7fd390070a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd380009e50 tx=0x7fd38002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0d9dbe5fa96720 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.463+0000 7fd38d59a640 1 -- 172.21.15.89:0/1142470664 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38002cb00 con 0x7fd3900b7c10 2023-08-25T09:41:58.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.463+0000 7fd38d59a640 1 -- 172.21.15.89:0/1142470664 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38002cc60 con 0x7fd3900b7c10 2023-08-25T09:41:58.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.463+0000 7fd38d59a640 1 -- 172.21.15.89:0/1142470664 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800343f0 con 0x7fd3900b7c10 2023-08-25T09:41:58.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 -- 172.21.15.89:0/1142470664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3900b7c10 msgr2=0x7fd390070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3900b7c10 0x7fd390070a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd380009e50 tx=0x7fd38002bf60 comp rx=0 tx=0).stop 2023-08-25T09:41:58.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 -- 172.21.15.89:0/1142470664 shutdown_connections 2023-08-25T09:41:58.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd390070fd0 0x7fd390141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 --2- 172.21.15.89:0/1142470664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3900b7c10 0x7fd390070a90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 -- 172.21.15.89:0/1142470664 >> 172.21.15.89:0/1142470664 conn(0x7fd390069a30 msgr2=0x7fd390069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 -- 172.21.15.89:0/1142470664 shutdown_connections 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.464+0000 7fd394b2f640 1 -- 172.21.15.89:0/1142470664 wait complete. 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 Processor -- start 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 -- start start 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39006fb00 0x7fd3900b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 0x7fd390148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3900b7c10 0x7fd3901e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900bb850 con 0x7fd390070fd0 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b5300 con 0x7fd39006fb00 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.465+0000 7fd394b2f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd390149320 con 0x7fd3900b7c10 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 0x7fd390148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 0x7fd390148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33518/0 (socket says 172.21.15.89:33518) 2023-08-25T09:41:58.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 -- 172.21.15.89:0/335123935 learned_addr learned my addr 172.21.15.89:0/335123935 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38e59c640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39006fb00 0x7fd3900b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38ed9d640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3900b7c10 0x7fd3901e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 -- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3900b7c10 msgr2=0x7fd3901e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3900b7c10 0x7fd3901e2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 -- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39006fb00 msgr2=0x7fd3900b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39006fb00 0x7fd3900b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 -- 172.21.15.89:0/335123935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009b30 con 0x7fd390070fd0 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38ed9d640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3900b7c10 0x7fd3901e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38e59c640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39006fb00 0x7fd3900b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd38dd9b640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 0x7fd390148cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c7f0 tx=0x7fd38400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384007a30 con 0x7fd390070fd0 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384007b90 con 0x7fd390070fd0 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3900b5550 con 0x7fd390070fd0 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400ce40 con 0x7fd390070fd0 2023-08-25T09:41:58.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.466+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3900b9cf0 con 0x7fd390070fd0 2023-08-25T09:41:58.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.467+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd390073bf0 con 0x7fd390070fd0 2023-08-25T09:41:58.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.468+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd3840113f0 con 0x7fd390070fd0 2023-08-25T09:41:58.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.468+0000 7fd37effd640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd37006a050 0x7fd37006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.468+0000 7fd38e59c640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd37006a050 0x7fd37006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.468+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd384088300 con 0x7fd390070fd0 2023-08-25T09:41:58.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.468+0000 7fd38e59c640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd37006a050 0x7fd37006c510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd380035000 tx=0x7fd380030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.472+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd384053dd0 con 0x7fd390070fd0 2023-08-25T09:41:58.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.643+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd39006ed90 con 0x7fd390070fd0 2023-08-25T09:41:58.645 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.643+0000 7fd37effd640 1 -- 172.21.15.89:0/335123935 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd3840573f0 con 0x7fd390070fd0 2023-08-25T09:41:58.646 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:41:58.648 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-08-25T09:41:58.648 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:41:58.648 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-08-25T09:41:58.649 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-08-25T09:41:58.649 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:41:58.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:41:58.652 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 2, 2023-08-25T09:41:58.652 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "rbd" 2023-08-25T09:41:58.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:41:58.653 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-08-25T09:41:58.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd37006a050 msgr2=0x7fd37006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd37006a050 0x7fd37006c510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd380035000 tx=0x7fd380030000 comp rx=0 tx=0).stop 2023-08-25T09:41:58.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 msgr2=0x7fd390148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 0x7fd390148cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c7f0 tx=0x7fd38400cbf0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 shutdown_connections 2023-08-25T09:41:58.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd37006a050 0x7fd37006c510 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd390070fd0 0x7fd390148cc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3900b7c10 0x7fd3901e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 --2- 172.21.15.89:0/335123935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39006fb00 0x7fd3900b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 >> 172.21.15.89:0/335123935 conn(0x7fd390069a30 msgr2=0x7fd3900b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:58.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 shutdown_connections 2023-08-25T09:41:58.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.645+0000 7fd394b2f640 1 -- 172.21.15.89:0/335123935 wait complete. 2023-08-25T09:41:58.660 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T09:41:58.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T09:41:58.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.764+0000 7fb9e84ec640 1 Processor -- start 2023-08-25T09:41:58.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.764+0000 7fb9e84ec640 1 -- start start 2023-08-25T09:41:58.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.764+0000 7fb9e84ec640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb9e006f9e0 0x7fb9e014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.764+0000 7fb9e84ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e0071140 con 0x7fb9e00714f0 2023-08-25T09:41:58.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.764+0000 7fb9e84ec640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e00b8990 con 0x7fb9e00b84d0 2023-08-25T09:41:58.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.764+0000 7fb9e84ec640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e014a8e0 con 0x7fb9e006f9e0 2023-08-25T09:41:58.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e6a89640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb9e00714f0 0x7fb9e0155130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33186/0 (socket says 172.21.15.89:33186) 2023-08-25T09:41:58.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e6a89640 1 -- 172.21.15.89:0/2243337185 learned_addr learned my addr 172.21.15.89:0/2243337185 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:41:58.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989353630 0 0) 0x7fb9e0071140 con 0x7fb9e00714f0 2023-08-25T09:41:58.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e6288640 1 --2- 172.21.15.89:0/2243337185 >> v2:172.21.15.121:3300/0 conn(0x7fb9e006f9e0 0x7fb9e014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9cc003520 con 0x7fb9e00714f0 2023-08-25T09:41:58.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534051931 0 0) 0x7fb9cc003520 con 0x7fb9e00714f0 2023-08-25T09:41:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 >> v2:172.21.15.121:3300/0 conn(0x7fb9e006f9e0 msgr2=0x7fb9e014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 --2- 172.21.15.89:0/2243337185 >> v2:172.21.15.121:3300/0 conn(0x7fb9e006f9e0 0x7fb9e014dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 >> v1:172.21.15.121:6789/0 conn(0x7fb9e00b84d0 legacy=0x7fb9e0144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e014abc0 con 0x7fb9e00714f0 2023-08-25T09:41:58.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e6288640 1 --2- 172.21.15.89:0/2243337185 >> v2:172.21.15.121:3300/0 conn(0x7fb9e006f9e0 0x7fb9e014dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:58.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fb9d80019f0 con 0x7fb9e00714f0 2023-08-25T09:41:58.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 >> v1:172.21.15.89:6789/0 conn(0x7fb9e00714f0 legacy=0x7fb9e0155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc003970 0x7fb9cc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9cc005180 0x7fb9cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e014a8e0 con 0x7fb9cc0047c0 2023-08-25T09:41:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00c030 con 0x7fb9cc003970 2023-08-25T09:41:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00c1f0 con 0x7fb9cc005180 2023-08-25T09:41:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e5a87640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e6288640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc003970 0x7fb9cc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.765+0000 7fb9e6a89640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9cc005180 0x7fb9cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5a87640 1 -- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9cc005180 msgr2=0x7fb9cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5a87640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9cc005180 0x7fb9cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5a87640 1 -- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc003970 msgr2=0x7fb9cc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5a87640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc003970 0x7fb9cc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5a87640 1 -- 172.21.15.89:0/2243337185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc003520 con 0x7fb9cc0047c0 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e6a89640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9cc005180 0x7fb9cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e6a89640 1 -- 172.21.15.89:0/2243337185 reap_dead start 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5a87640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001750 tx=0x7fb9cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ae99b8ab233230 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00052d0 con 0x7fb9cc0047c0 2023-08-25T09:41:58.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d002e050 con 0x7fb9cc0047c0 2023-08-25T09:41:58.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.766+0000 7fb9e5286640 1 -- 172.21.15.89:0/2243337185 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0003830 con 0x7fb9cc0047c0 2023-08-25T09:41:58.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 -- 172.21.15.89:0/2243337185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9cc0047c0 msgr2=0x7fb9cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001750 tx=0x7fb9cc0057f0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 -- 172.21.15.89:0/2243337185 shutdown_connections 2023-08-25T09:41:58.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/2243337185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9cc0047c0 0x7fb9cc004c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 -- 172.21.15.89:0/2243337185 >> 172.21.15.89:0/2243337185 conn(0x7fb9e00bcf30 msgr2=0x7fb9e00bd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:58.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 -- 172.21.15.89:0/2243337185 shutdown_connections 2023-08-25T09:41:58.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.767+0000 7fb9e84ec640 1 -- 172.21.15.89:0/2243337185 wait complete. 2023-08-25T09:41:58.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.768+0000 7fb9e84ec640 1 Processor -- start 2023-08-25T09:41:58.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.768+0000 7fb9e84ec640 1 -- start start 2023-08-25T09:41:58.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc0047c0 0x7fb9e0145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9e014d840 0x7fb9e014c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 0x7fb9e0147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e014c3d0 con 0x7fb9e0149ba0 2023-08-25T09:41:58.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e0147ba0 con 0x7fb9cc0047c0 2023-08-25T09:41:58.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e014a030 con 0x7fb9e014d840 2023-08-25T09:41:58.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 0x7fb9e0147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 0x7fb9e0147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33542/0 (socket says 172.21.15.89:33542) 2023-08-25T09:41:58.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 -- 172.21.15.89:0/1901702762 learned_addr learned my addr 172.21.15.89:0/1901702762 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:58.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6288640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc0047c0 0x7fb9e0145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e5a87640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9e014d840 0x7fb9e014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 -- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9e014d840 msgr2=0x7fb9e014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9e014d840 0x7fb9e014c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 -- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc0047c0 msgr2=0x7fb9e0145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:58.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc0047c0 0x7fb9e0145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:58.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 -- 172.21.15.89:0/1901702762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e014baa0 con 0x7fb9e0149ba0 2023-08-25T09:41:58.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6288640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc0047c0 0x7fb9e0145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:58.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e6a89640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 0x7fb9e0147660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8004e10 tx=0x7fb9d80061c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8006b50 con 0x7fb9e0149ba0 2023-08-25T09:41:58.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8006cd0 con 0x7fb9e0149ba0 2023-08-25T09:41:58.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e014bd80 con 0x7fb9e0149ba0 2023-08-25T09:41:58.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8015480 con 0x7fb9e0149ba0 2023-08-25T09:41:58.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.769+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0147e20 con 0x7fb9e0149ba0 2023-08-25T09:41:58.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.770+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e014c580 con 0x7fb9e0149ba0 2023-08-25T09:41:58.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.771+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9d8015600 con 0x7fb9e0149ba0 2023-08-25T09:41:58.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.771+0000 7fb9d6ffd640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb9c406a080 0x7fb9c406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:58.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.771+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb9d8088340 con 0x7fb9e0149ba0 2023-08-25T09:41:58.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.771+0000 7fb9e6288640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb9c406a080 0x7fb9c406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:58.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.772+0000 7fb9e6288640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb9c406a080 0x7fb9c406c540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc006fd0 tx=0x7fb9dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:58.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.775+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb9e014c580 con 0x7fb9e0149ba0 2023-08-25T09:41:58.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:58.942+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb9e014c580 con 0x7fb9e0149ba0 2023-08-25T09:41:59.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.235+0000 7fb9d6ffd640 1 -- 172.21.15.89:0/1901702762 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb9e014c580 con 0x7fb9e0149ba0 2023-08-25T09:41:59.237 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2023-08-25T09:41:59.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.239+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb9c406a080 msgr2=0x7fb9c406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:59.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.239+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb9c406a080 0x7fb9c406c540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc006fd0 tx=0x7fb9dc008040 comp rx=0 tx=0).stop 2023-08-25T09:41:59.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.239+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 msgr2=0x7fb9e0147660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:59.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.239+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 0x7fb9e0147660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8004e10 tx=0x7fb9d80061c0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 shutdown_connections 2023-08-25T09:41:59.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb9c406a080 0x7fb9c406c540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9e0149ba0 0x7fb9e0147660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9e014d840 0x7fb9e014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 --2- 172.21.15.89:0/1901702762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9cc0047c0 0x7fb9e0145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 >> 172.21.15.89:0/1901702762 conn(0x7fb9e00bcf30 msgr2=0x7fb9e00b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:59.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 shutdown_connections 2023-08-25T09:41:59.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.240+0000 7fb9e84ec640 1 -- 172.21.15.89:0/1901702762 wait complete. 2023-08-25T09:41:59.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T09:41:59.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.356+0000 7ff95b8a6640 1 Processor -- start 2023-08-25T09:41:59.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.356+0000 7ff95b8a6640 1 -- start start 2023-08-25T09:41:59.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff95b8a6640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9540b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:59.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff95b8a6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff954070f20 0x7ff954141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:59.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff95b8a6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95406e880 con 0x7ff9541415c0 2023-08-25T09:41:59.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff95b8a6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540b3570 con 0x7ff954070f20 2023-08-25T09:41:59.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff95b8a6640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540b3000 con 0x7ff9540b7b80 2023-08-25T09:41:59.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff954070f20 0x7ff954141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:59.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff954070f20 0x7ff954141a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33558/0 (socket says 172.21.15.89:33558) 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 -- 172.21.15.89:0/4251020462 learned_addr learned my addr 172.21.15.89:0/4251020462 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 -- 172.21.15.89:0/4251020462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 msgr2=0x7ff9540b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959642640 1 --2- 172.21.15.89:0/4251020462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9540b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 --2- 172.21.15.89:0/4251020462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9540b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 -- 172.21.15.89:0/4251020462 >> v1:172.21.15.121:6789/0 conn(0x7ff9541415c0 legacy=0x7ff954070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.357+0000 7ff959e43640 1 -- 172.21.15.89:0/4251020462 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95414ab90 con 0x7ff954070f20 2023-08-25T09:41:59.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.358+0000 7ff959e43640 1 --2- 172.21.15.89:0/4251020462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff954070f20 0x7ff954141a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009e50 tx=0x7ff94c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a131de289d1ba3be server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:59.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.358+0000 7ff94bfff640 1 -- 172.21.15.89:0/4251020462 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c02c9e0 con 0x7ff954070f20 2023-08-25T09:41:59.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.358+0000 7ff94bfff640 1 -- 172.21.15.89:0/4251020462 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c02cb40 con 0x7ff954070f20 2023-08-25T09:41:59.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.358+0000 7ff94bfff640 1 -- 172.21.15.89:0/4251020462 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0343f0 con 0x7ff954070f20 2023-08-25T09:41:59.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 -- 172.21.15.89:0/4251020462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff954070f20 msgr2=0x7ff954141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:59.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/4251020462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff954070f20 0x7ff954141a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009e50 tx=0x7ff94c02be40 comp rx=0 tx=0).stop 2023-08-25T09:41:59.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 -- 172.21.15.89:0/4251020462 shutdown_connections 2023-08-25T09:41:59.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/4251020462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff954070f20 0x7ff954141a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/4251020462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9540b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 -- 172.21.15.89:0/4251020462 >> 172.21.15.89:0/4251020462 conn(0x7ff9540bbe80 msgr2=0x7ff9540bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:41:59.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 -- 172.21.15.89:0/4251020462 shutdown_connections 2023-08-25T09:41:59.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.359+0000 7ff95b8a6640 1 -- 172.21.15.89:0/4251020462 wait complete. 2023-08-25T09:41:59.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 Processor -- start 2023-08-25T09:41:59.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 -- start start 2023-08-25T09:41:59.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9541e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:59.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 0x7ff9541ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:59.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9541383d0 0x7ff954136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:59.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954141020 con 0x7ff9541415c0 2023-08-25T09:41:59.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540b5d80 con 0x7ff9541383d0 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.360+0000 7ff95b8a6640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff954138c00 con 0x7ff9540b7b80 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 0x7ff9541ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 0x7ff9541ddef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33572/0 (socket says 172.21.15.89:33572) 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 -- 172.21.15.89:0/1723025842 learned_addr learned my addr 172.21.15.89:0/1723025842 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff959e43640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9541383d0 0x7ff954136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff959642640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9541e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:59.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 -- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 msgr2=0x7ff9541e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9541e1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 -- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9541383d0 msgr2=0x7ff954136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9541383d0 0x7ff954136bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 -- 172.21.15.89:0/1723025842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009b30 con 0x7ff9541415c0 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff959e43640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9541383d0 0x7ff954136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff959642640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9541e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff958e41640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 0x7ff9541ddef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b3f0 tx=0x7ff94400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:59.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944011830 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944011990 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9541e1490 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944011d40 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.361+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9541e1a50 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.362+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9540b6f10 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.363+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff94401a400 con 0x7ff9541415c0 2023-08-25T09:41:59.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.363+0000 7ff949ffb640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff93806a080 0x7ff93806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:41:59.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.363+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff9440881d0 con 0x7ff9541415c0 2023-08-25T09:41:59.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.363+0000 7ff959642640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff93806a080 0x7ff93806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:41:59.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.363+0000 7ff959642640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff93806a080 0x7ff93806c540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff95000a9d0 tx=0x7ff950008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:41:59.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.367+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff944053b30 con 0x7ff9541415c0 2023-08-25T09:41:59.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:41:59.534+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff95414ba30 con 0x7ff9541415c0 2023-08-25T09:42:00.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:00.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:00.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:00.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.238+0000 7ff949ffb640 1 -- 172.21.15.89:0/1723025842 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff944057150 con 0x7ff9541415c0 2023-08-25T09:42:00.245 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2023-08-25T09:42:00.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.243+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff93806a080 msgr2=0x7ff93806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:00.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.243+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff93806a080 0x7ff93806c540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff95000a9d0 tx=0x7ff950008040 comp rx=0 tx=0).stop 2023-08-25T09:42:00.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.243+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 msgr2=0x7ff9541ddef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:00.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.243+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 0x7ff9541ddef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b3f0 tx=0x7ff94400b8b0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.245+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 shutdown_connections 2023-08-25T09:42:00.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.245+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff93806a080 0x7ff93806c540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.245+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9541415c0 0x7ff9541ddef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.245+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9541383d0 0x7ff954136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.245+0000 7ff95b8a6640 1 --2- 172.21.15.89:0/1723025842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9540b7b80 0x7ff9541e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.245+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 >> 172.21.15.89:0/1723025842 conn(0x7ff9540bbe80 msgr2=0x7ff9540b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:00.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.246+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 shutdown_connections 2023-08-25T09:42:00.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.249+0000 7ff95b8a6640 1 -- 172.21.15.89:0/1723025842 wait complete. 2023-08-25T09:42:00.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T09:42:00.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.405+0000 7f35e7b98640 1 Processor -- start 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.405+0000 7f35e7b98640 1 -- start start 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e7b98640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35e00b6890 0x7f35e00ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e7b98640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 0x7f35e01423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e7b98640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e0070ba0 con 0x7f35e0071030 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e7b98640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e00baa10 con 0x7f35e00b6890 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e7b98640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00705b0 con 0x7f35e00b7950 2023-08-25T09:42:00.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e5133640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f35e0071030 0x7f35e014bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33202/0 (socket says 172.21.15.89:33202) 2023-08-25T09:42:00.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e5133640 1 -- 172.21.15.89:0/4061628250 learned_addr learned my addr 172.21.15.89:0/4061628250 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:00.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e6135640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 0x7f35e01423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e5934640 1 --2- 172.21.15.89:0/4061628250 >> v2:172.21.15.121:3300/0 conn(0x7f35e00b6890 0x7f35e00ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443755825 0 0) 0x7f35e0070ba0 con 0x7f35e0071030 2023-08-25T09:42:00.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35cc003520 con 0x7f35e0071030 2023-08-25T09:42:00.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319206831 0 0) 0x7f35cc003520 con 0x7f35e0071030 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 msgr2=0x7f35e01423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 0x7f35e01423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 >> v2:172.21.15.121:3300/0 conn(0x7f35e00b6890 msgr2=0x7f35e00ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 --2- 172.21.15.89:0/4061628250 >> v2:172.21.15.121:3300/0 conn(0x7f35e00b6890 0x7f35e00ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00b7de0 con 0x7f35e0071030 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f35d0001670 con 0x7f35e0071030 2023-08-25T09:42:00.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 >> v1:172.21.15.89:6789/0 conn(0x7f35e0071030 legacy=0x7f35e014bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:00.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35cc003970 0x7f35cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 0x7f35cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc004d00 0x7f35cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.406+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00baa10 con 0x7f35cc003970 2023-08-25T09:42:00.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00705b0 con 0x7f35cc004d00 2023-08-25T09:42:00.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc00b980 con 0x7f35e00b7950 2023-08-25T09:42:00.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35cc003970 0x7f35cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e6135640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc004d00 0x7f35cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5133640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 0x7f35cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 -- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 msgr2=0x7f35cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:00.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e00b7950 0x7f35cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 -- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc004d00 msgr2=0x7f35cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:00.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc004d00 0x7f35cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 -- 172.21.15.89:0/4061628250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc003520 con 0x7f35cc003970 2023-08-25T09:42:00.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e6135640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc004d00 0x7f35cc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:00.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.407+0000 7f35e5934640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35cc003970 0x7f35cc003d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009ac0 tx=0x7f35cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b995e37758e0db1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:00.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc02c710 con 0x7f35cc003970 2023-08-25T09:42:00.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc02c870 con 0x7f35cc003970 2023-08-25T09:42:00.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e4932640 1 -- 172.21.15.89:0/4061628250 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc02cc00 con 0x7f35cc003970 2023-08-25T09:42:00.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e7b98640 1 -- 172.21.15.89:0/4061628250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35cc003970 msgr2=0x7f35cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:00.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e7b98640 1 --2- 172.21.15.89:0/4061628250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35cc003970 0x7f35cc003d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009ac0 tx=0x7f35cc0057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e6135640 1 -- 172.21.15.89:0/4061628250 reap_dead start 2023-08-25T09:42:00.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e7b98640 1 -- 172.21.15.89:0/4061628250 shutdown_connections 2023-08-25T09:42:00.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e7b98640 1 -- 172.21.15.89:0/4061628250 >> 172.21.15.89:0/4061628250 conn(0x7f35e006d350 msgr2=0x7f35e006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:00.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e7b98640 1 -- 172.21.15.89:0/4061628250 shutdown_connections 2023-08-25T09:42:00.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.408+0000 7f35e7b98640 1 -- 172.21.15.89:0/4061628250 wait complete. 2023-08-25T09:42:00.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.409+0000 7f35e7b98640 1 Processor -- start 2023-08-25T09:42:00.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.409+0000 7f35e7b98640 1 -- start start 2023-08-25T09:42:00.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e7b98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc003970 0x7f35e01438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e7b98640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e01458e0 0x7f35e014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e7b98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 0x7f35e013d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e7b98640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e0146080 con 0x7f35e014b3b0 2023-08-25T09:42:00.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e7b98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e0148c10 con 0x7f35cc003970 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e7b98640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e0145da0 con 0x7f35e01458e0 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 0x7f35e013d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 0x7f35e013d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33590/0 (socket says 172.21.15.89:33590) 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 -- 172.21.15.89:0/2600351442 learned_addr learned my addr 172.21.15.89:0/2600351442 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e5934640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc003970 0x7f35e01438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e5133640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e01458e0 0x7f35e014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 -- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e01458e0 msgr2=0x7f35e014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e01458e0 0x7f35e014ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 -- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc003970 msgr2=0x7f35e01438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc003970 0x7f35e01438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 -- 172.21.15.89:0/2600351442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0148eb0 con 0x7f35e014b3b0 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.410+0000 7f35e6135640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 0x7f35e013d0e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35e00b7d30 tx=0x7f35d8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.411+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d800e050 con 0x7f35e014b3b0 2023-08-25T09:42:00.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.411+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d800f040 con 0x7f35e014b3b0 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.411+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e0142d60 con 0x7f35e014b3b0 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.411+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8007ea0 con 0x7f35e014b3b0 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.411+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e0143e10 con 0x7f35e014b3b0 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.411+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e01490a0 con 0x7f35e014b3b0 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.412+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f35d8015440 con 0x7f35e014b3b0 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.412+0000 7f35d67fc640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35c406a050 0x7f35c406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:00.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.412+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f35d8088750 con 0x7f35e014b3b0 2023-08-25T09:42:00.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.412+0000 7f35e5934640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35c406a050 0x7f35c406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:00.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.413+0000 7f35e5934640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35c406a050 0x7f35c406c510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35dc036000 tx=0x7f35dc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:00.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.417+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f35d80579c0 con 0x7f35e014b3b0 2023-08-25T09:42:00.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:00.620+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f35e004dc40 con 0x7f35e014b3b0 2023-08-25T09:42:01.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.270+0000 7f35d67fc640 1 -- 172.21.15.89:0/2600351442 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f35d8057550 con 0x7f35e014b3b0 2023-08-25T09:42:01.273 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 3 and data pool 4 2023-08-25T09:42:01.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35c406a050 msgr2=0x7f35c406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35c406a050 0x7f35c406c510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35dc036000 tx=0x7f35dc030000 comp rx=0 tx=0).stop 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 msgr2=0x7f35e013d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 0x7f35e013d0e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35e00b7d30 tx=0x7f35d8010590 comp rx=0 tx=0).stop 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 shutdown_connections 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35c406a050 0x7f35c406c510 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e014b3b0 0x7f35e013d0e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35e01458e0 0x7f35e014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 --2- 172.21.15.89:0/2600351442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35cc003970 0x7f35e01438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.273+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 >> 172.21.15.89:0/2600351442 conn(0x7f35e006d350 msgr2=0x7f35e00bc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:01.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.274+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 shutdown_connections 2023-08-25T09:42:01.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.274+0000 7f35e7b98640 1 -- 172.21.15.89:0/2600351442 wait complete. 2023-08-25T09:42:01.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:01.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.385+0000 7fc9a72f3640 1 Processor -- start 2023-08-25T09:42:01.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.385+0000 7fc9a72f3640 1 -- start start 2023-08-25T09:42:01.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a72f3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a00be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a72f3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9a00bfcf0 0x7fc9a00a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a72f3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00be5b0 con 0x7fc9a00b3990 2023-08-25T09:42:01.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a72f3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a006a390 con 0x7fc9a00bfcf0 2023-08-25T09:42:01.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a72f3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00bf5c0 con 0x7fc9a00bae60 2023-08-25T09:42:01.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9a00bfcf0 0x7fc9a00a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9a00bfcf0 0x7fc9a00a5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33604/0 (socket says 172.21.15.89:33604) 2023-08-25T09:42:01.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 -- 172.21.15.89:0/2506751393 learned_addr learned my addr 172.21.15.89:0/2506751393 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:01.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a488e640 1 --1- 172.21.15.89:0/2506751393 >> v1:172.21.15.89:6789/0 conn(0x7fc9a00b3990 0x7fc9a00a5500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33214/0 (socket says 172.21.15.89:33214) 2023-08-25T09:42:01.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 -- 172.21.15.89:0/2506751393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 msgr2=0x7fc9a00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:01.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a508f640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a00be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc997fff640 1 -- 172.21.15.89:0/2506751393 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950875319 0 0) 0x7fc9a00be5b0 con 0x7fc9a00b3990 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a00be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 -- 172.21.15.89:0/2506751393 >> v1:172.21.15.89:6789/0 conn(0x7fc9a00b3990 legacy=0x7fc9a00a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a5890640 1 -- 172.21.15.89:0/2506751393 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a006a580 con 0x7fc9a00bfcf0 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.386+0000 7fc9a508f640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.387+0000 7fc9a5890640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a00a5c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc998009870 tx=0x7fc99802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e301377e3dc33f68 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.387+0000 7fc997fff640 1 -- 172.21.15.89:0/2506751393 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998031640 con 0x7fc9a00bfcf0 2023-08-25T09:42:01.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.387+0000 7fc997fff640 1 -- 172.21.15.89:0/2506751393 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9980317a0 con 0x7fc9a00bfcf0 2023-08-25T09:42:01.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.387+0000 7fc997fff640 1 -- 172.21.15.89:0/2506751393 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998031b30 con 0x7fc9a00bfcf0 2023-08-25T09:42:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 -- 172.21.15.89:0/2506751393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00bfcf0 msgr2=0x7fc9a00a5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a00a5c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc998009870 tx=0x7fc99802b8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 -- 172.21.15.89:0/2506751393 shutdown_connections 2023-08-25T09:42:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a00a5c10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/2506751393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 -- 172.21.15.89:0/2506751393 >> 172.21.15.89:0/2506751393 conn(0x7fc9a00c0270 msgr2=0x7fc9a00c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:01.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 -- 172.21.15.89:0/2506751393 shutdown_connections 2023-08-25T09:42:01.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.388+0000 7fc9a72f3640 1 -- 172.21.15.89:0/2506751393 wait complete. 2023-08-25T09:42:01.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.389+0000 7fc9a72f3640 1 Processor -- start 2023-08-25T09:42:01.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.389+0000 7fc9a72f3640 1 -- start start 2023-08-25T09:42:01.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 0x7fc9a014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a0143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a01443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01e43c0 con 0x7fc9a00b3990 2023-08-25T09:42:01.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01e3ad0 con 0x7fc9a00bfcf0 2023-08-25T09:42:01.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01e3d70 con 0x7fc9a00bae60 2023-08-25T09:42:01.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 0x7fc9a014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 0x7fc9a014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33618/0 (socket says 172.21.15.89:33618) 2023-08-25T09:42:01.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 -- 172.21.15.89:0/1463244043 learned_addr learned my addr 172.21.15.89:0/1463244043 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:01.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a488e640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a0143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a5890640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a01443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 -- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 msgr2=0x7fc9a0143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a0143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 -- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a00bfcf0 msgr2=0x7fc9a01443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a01443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 -- 172.21.15.89:0/1463244043 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980094d0 con 0x7fc9a00b3990 2023-08-25T09:42:01.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a5890640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a01443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:01.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a488e640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a0143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:01.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a508f640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 0x7fc9a014e380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00cf60 tx=0x7fc99c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00d840 con 0x7fc9a00b3990 2023-08-25T09:42:01.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00d9a0 con 0x7fc9a00b3990 2023-08-25T09:42:01.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a01e4050 con 0x7fc9a00b3990 2023-08-25T09:42:01.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00dd30 con 0x7fc9a00b3990 2023-08-25T09:42:01.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.390+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a0147070 con 0x7fc9a00b3990 2023-08-25T09:42:01.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.391+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a01472f0 con 0x7fc9a00b3990 2023-08-25T09:42:01.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.391+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc99c015440 con 0x7fc9a00b3990 2023-08-25T09:42:01.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.392+0000 7fc995ffb640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc98406a050 0x7fc98406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.392+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc99c088e80 con 0x7fc9a00b3990 2023-08-25T09:42:01.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.392+0000 7fc9a488e640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc98406a050 0x7fc98406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.392+0000 7fc9a488e640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc98406a050 0x7fc98406c510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9a01e11d0 tx=0x7fc990009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.396+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc99c0546b0 con 0x7fc9a00b3990 2023-08-25T09:42:01.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.564+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a00a1ae0 con 0x7fc9a00b3990 2023-08-25T09:42:01.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.565+0000 7fc995ffb640 1 -- 172.21.15.89:0/1463244043 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18292 (secure 0 0 0) 0x7fc99c057cd0 con 0x7fc9a00b3990 2023-08-25T09:42:01.568 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:01.568 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:00.621390+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:01.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc98406a050 msgr2=0x7fc98406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc98406a050 0x7fc98406c510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9a01e11d0 tx=0x7fc990009040 comp rx=0 tx=0).stop 2023-08-25T09:42:01.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 msgr2=0x7fc9a014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 0x7fc9a014e380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00cf60 tx=0x7fc99c00cf90 comp rx=0 tx=0).stop 2023-08-25T09:42:01.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 shutdown_connections 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc98406a050 0x7fc98406c510 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a00bfcf0 0x7fc9a01443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9a00bae60 0x7fc9a0143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 --2- 172.21.15.89:0/1463244043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b3990 0x7fc9a014e380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 >> 172.21.15.89:0/1463244043 conn(0x7fc9a00c0270 msgr2=0x7fc9a00a4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 shutdown_connections 2023-08-25T09:42:01.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.567+0000 7fc9a72f3640 1 -- 172.21.15.89:0/1463244043 wait complete. 2023-08-25T09:42:01.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:01.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.680+0000 7f2a8056a640 1 Processor -- start 2023-08-25T09:42:01.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.680+0000 7f2a8056a640 1 -- start start 2023-08-25T09:42:01.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a8056a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7806abd0 0x7f2a780b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a8056a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2a7814a9e0 0x7f2a7814b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a8056a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a7814b680 0x7f2a7814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a8056a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7806c9b0 con 0x7f2a7814b680 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a8056a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780b52a0 con 0x7f2a7814a9e0 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a8056a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7806bfb0 con 0x7f2a7806abd0 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a7814b680 0x7f2a7814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a7814b680 0x7f2a7814dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33630/0 (socket says 172.21.15.89:33630) 2023-08-25T09:42:01.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3024541074 learned_addr learned my addr 172.21.15.89:0/3024541074 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7db05640 1 --2- 172.21.15.89:0/3024541074 >> v2:172.21.15.121:3300/0 conn(0x7f2a7814a9e0 0x7f2a7814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7e306640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7806abd0 0x7f2a780b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3024541074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7806abd0 msgr2=0x7f2a780b96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7806abd0 0x7f2a780b96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3024541074 >> v2:172.21.15.121:3300/0 conn(0x7f2a7814a9e0 msgr2=0x7f2a7814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 --2- 172.21.15.89:0/3024541074 >> v2:172.21.15.121:3300/0 conn(0x7f2a7814a9e0 0x7f2a7814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3024541074 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7814ae20 con 0x7f2a7814b680 2023-08-25T09:42:01.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7db05640 1 --2- 172.21.15.89:0/3024541074 >> v2:172.21.15.121:3300/0 conn(0x7f2a7814a9e0 0x7f2a7814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:01.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.681+0000 7f2a7e306640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7806abd0 0x7f2a780b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:01.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.682+0000 7f2a7eb07640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a7814dee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a78066de0 tx=0x7f2a7002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61db362576144250 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.682+0000 7f2a7d304640 1 -- 172.21.15.89:0/3024541074 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7002ca80 con 0x7f2a7814b680 2023-08-25T09:42:01.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.682+0000 7f2a7d304640 1 -- 172.21.15.89:0/3024541074 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7002cbe0 con 0x7f2a7814b680 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.682+0000 7f2a7d304640 1 -- 172.21.15.89:0/3024541074 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a700343f0 con 0x7f2a7814b680 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 -- 172.21.15.89:0/3024541074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 msgr2=0x7f2a7814dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a7814dee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a78066de0 tx=0x7f2a7002bee0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 -- 172.21.15.89:0/3024541074 shutdown_connections 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a7814dee0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3024541074 >> v2:172.21.15.121:3300/0 conn(0x7f2a7814a9e0 0x7f2a7814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3024541074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7806abd0 0x7f2a780b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 -- 172.21.15.89:0/3024541074 >> 172.21.15.89:0/3024541074 conn(0x7f2a780bab60 msgr2=0x7f2a780baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 -- 172.21.15.89:0/3024541074 shutdown_connections 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.683+0000 7f2a8056a640 1 -- 172.21.15.89:0/3024541074 wait complete. 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.684+0000 7f2a8056a640 1 Processor -- start 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.684+0000 7f2a8056a640 1 -- start start 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a7806abd0 0x7f2a7809d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7814a9e0 0x7f2a781453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a78145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7809eb80 con 0x7f2a7814b680 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78147770 con 0x7f2a7806abd0 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78147a50 con 0x7f2a7814a9e0 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a78145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a78145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33642/0 (socket says 172.21.15.89:33642) 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3579939558 learned_addr learned my addr 172.21.15.89:0/3579939558 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:01.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7e306640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a7806abd0 0x7f2a7809d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7db05640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7814a9e0 0x7f2a781453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7814a9e0 msgr2=0x7f2a781453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7814a9e0 0x7f2a781453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a7806abd0 msgr2=0x7f2a7809d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a7806abd0 0x7f2a7809d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 -- 172.21.15.89:0/3579939558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009b30 con 0x7f2a7814b680 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7e306640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a7806abd0 0x7f2a7809d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:01.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a7eb07640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a78145920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009e50 tx=0x7f2a70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70009510 con 0x7f2a7814b680 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7003e450 con 0x7f2a7814b680 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a78147d30 con 0x7f2a7814b680 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7003e800 con 0x7f2a7814b680 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.685+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a78149050 con 0x7f2a7814b680 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.686+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a78070f30 con 0x7f2a7814b680 2023-08-25T09:42:01.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.687+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a7002cd50 con 0x7f2a7814b680 2023-08-25T09:42:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.687+0000 7f2a6effd640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a5c06a050 0x7f2a5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.687+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a700ab230 con 0x7f2a7814b680 2023-08-25T09:42:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.687+0000 7f2a7e306640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a5c06a050 0x7f2a5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.687+0000 7f2a7e306640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a5c06a050 0x7f2a5c06c510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a740088b0 tx=0x7f2a74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.691+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a70076940 con 0x7f2a7814b680 2023-08-25T09:42:01.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.859+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a78073bf0 con 0x7f2a7814b680 2023-08-25T09:42:01.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.860+0000 7f2a6effd640 1 -- 172.21.15.89:0/3579939558 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f2a70079f60 con 0x7f2a7814b680 2023-08-25T09:42:01.863 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:01.863 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:00.621390+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a5c06a050 msgr2=0x7f2a5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a5c06a050 0x7f2a5c06c510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a740088b0 tx=0x7f2a74008040 comp rx=0 tx=0).stop 2023-08-25T09:42:01.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 msgr2=0x7f2a78145920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a78145920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009e50 tx=0x7f2a70004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:01.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 shutdown_connections 2023-08-25T09:42:01.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2a5c06a050 0x7f2a5c06c510 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a7814b680 0x7f2a78145920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a7814a9e0 0x7f2a781453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 --2- 172.21.15.89:0/3579939558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a7806abd0 0x7f2a7809d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 >> 172.21.15.89:0/3579939558 conn(0x7f2a780bab60 msgr2=0x7f2a78070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:01.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 shutdown_connections 2023-08-25T09:42:01.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.862+0000 7f2a8056a640 1 -- 172.21.15.89:0/3579939558 wait complete. 2023-08-25T09:42:01.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T09:42:01.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.973+0000 7fa48cf99640 1 Processor -- start 2023-08-25T09:42:01.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.973+0000 7fa48cf99640 1 -- start start 2023-08-25T09:42:01.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa48cf99640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4880b5720 0x7fa48806ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa48cf99640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4880b7820 0x7fa48806fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa48cf99640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa488070a70 con 0x7fa488070280 2023-08-25T09:42:01.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa48cf99640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa488070f00 con 0x7fa4880b5720 2023-08-25T09:42:01.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa48cf99640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48806f290 con 0x7fa4880b7820 2023-08-25T09:42:01.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa48659c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa4880b5720 0x7fa48806ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa486d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa488070280 0x7fa48814a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33224/0 (socket says 172.21.15.89:33224) 2023-08-25T09:42:01.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.974+0000 7fa486d9d640 1 -- 172.21.15.89:0/1587823429 learned_addr learned my addr 172.21.15.89:0/1587823429 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:01.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa485d9b640 1 --2- 172.21.15.89:0/1587823429 >> v2:172.21.15.121:3300/0 conn(0x7fa4880b7820 0x7fa48806fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48659c640 1 -- 172.21.15.89:0/1587823429 >> v2:172.21.15.121:3300/0 conn(0x7fa4880b7820 msgr2=0x7fa48806fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:01.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48659c640 1 --2- 172.21.15.89:0/1587823429 >> v2:172.21.15.121:3300/0 conn(0x7fa4880b7820 0x7fa48806fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48659c640 1 -- 172.21.15.89:0/1587823429 >> v1:172.21.15.89:6789/0 conn(0x7fa488070280 legacy=0x7fa48814a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48659c640 1 -- 172.21.15.89:0/1587823429 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488070700 con 0x7fa4880b5720 2023-08-25T09:42:01.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48559a640 1 -- 172.21.15.89:0/1587823429 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546207206 0 0) 0x7fa488070a70 con 0x7fa488070280 2023-08-25T09:42:01.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48659c640 1 --2- 172.21.15.89:0/1587823429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b5720 0x7fa48806ebc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4880b3560 tx=0x7fa48002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751735dbb946e5f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.975+0000 7fa48559a640 1 -- 172.21.15.89:0/1587823429 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480031830 con 0x7fa4880b5720 2023-08-25T09:42:01.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48559a640 1 -- 172.21.15.89:0/1587823429 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480031990 con 0x7fa4880b5720 2023-08-25T09:42:01.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48559a640 1 -- 172.21.15.89:0/1587823429 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480031d20 con 0x7fa4880b5720 2023-08-25T09:42:01.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 -- 172.21.15.89:0/1587823429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b5720 msgr2=0x7fa48806ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 --2- 172.21.15.89:0/1587823429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b5720 0x7fa48806ebc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4880b3560 tx=0x7fa48002b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 -- 172.21.15.89:0/1587823429 shutdown_connections 2023-08-25T09:42:01.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 --2- 172.21.15.89:0/1587823429 >> v2:172.21.15.121:3300/0 conn(0x7fa4880b7820 0x7fa48806fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 --2- 172.21.15.89:0/1587823429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b5720 0x7fa48806ebc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 -- 172.21.15.89:0/1587823429 >> 172.21.15.89:0/1587823429 conn(0x7fa488069850 msgr2=0x7fa488069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 -- 172.21.15.89:0/1587823429 shutdown_connections 2023-08-25T09:42:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.976+0000 7fa48cf99640 1 -- 172.21.15.89:0/1587823429 wait complete. 2023-08-25T09:42:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.977+0000 7fa48cf99640 1 Processor -- start 2023-08-25T09:42:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.977+0000 7fa48cf99640 1 -- start start 2023-08-25T09:42:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48cf99640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa488070280 0x7fa488145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48cf99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4880b5720 0x7fa4881445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48cf99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 0x7fa488144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48cf99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488143a80 con 0x7fa4880b7820 2023-08-25T09:42:01.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48cf99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488146060 con 0x7fa4880b5720 2023-08-25T09:42:01.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48cf99640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488143190 con 0x7fa488070280 2023-08-25T09:42:01.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 0x7fa488144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 0x7fa488144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33656/0 (socket says 172.21.15.89:33656) 2023-08-25T09:42:01.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 -- 172.21.15.89:0/3989851899 learned_addr learned my addr 172.21.15.89:0/3989851899 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:01.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa485d9b640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4880b5720 0x7fa4881445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa48659c640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa488070280 0x7fa488145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 -- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa488070280 msgr2=0x7fa488145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa488070280 0x7fa488145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 -- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4880b5720 msgr2=0x7fa4881445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:01.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4880b5720 0x7fa4881445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:01.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.978+0000 7fa486d9d640 1 -- 172.21.15.89:0/3989851899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009400 con 0x7fa4880b7820 2023-08-25T09:42:01.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.979+0000 7fa486d9d640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 0x7fa488144b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa478001560 tx=0x7fa47800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.979+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800a640 con 0x7fa4880b7820 2023-08-25T09:42:01.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.979+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47800a7a0 con 0x7fa4880b7820 2023-08-25T09:42:01.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.979+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800ab30 con 0x7fa4880b7820 2023-08-25T09:42:01.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.979+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa488143430 con 0x7fa4880b7820 2023-08-25T09:42:01.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.979+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880bae10 con 0x7fa4880b7820 2023-08-25T09:42:01.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.980+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa488143c30 con 0x7fa4880b7820 2023-08-25T09:42:01.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.980+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa47800ac90 con 0x7fa4880b7820 2023-08-25T09:42:01.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.980+0000 7fa47effd640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa46806a080 0x7fa46806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:01.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.981+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4780879b0 con 0x7fa4880b7820 2023-08-25T09:42:01.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.981+0000 7fa48659c640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa46806a080 0x7fa46806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:01.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.981+0000 7fa48659c640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa46806a080 0x7fa46806c540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa480036000 tx=0x7fa48003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:01.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:01.985+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa488143c30 con 0x7fa4880b7820 2023-08-25T09:42:02.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.184+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa488143c30 con 0x7fa4880b7820 2023-08-25T09:42:02.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.271+0000 7fa47effd640 1 -- 172.21.15.89:0/3989851899 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa488143c30 con 0x7fa4880b7820 2023-08-25T09:42:02.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa46806a080 msgr2=0x7fa46806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa46806a080 0x7fa46806c540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa480036000 tx=0x7fa48003c040 comp rx=0 tx=0).stop 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 msgr2=0x7fa488144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 0x7fa488144b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa478001560 tx=0x7fa47800cc70 comp rx=0 tx=0).stop 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 shutdown_connections 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa46806a080 0x7fa46806c540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4880b7820 0x7fa488144b10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4880b5720 0x7fa4881445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 --2- 172.21.15.89:0/3989851899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa488070280 0x7fa488145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 >> 172.21.15.89:0/3989851899 conn(0x7fa488069850 msgr2=0x7fa4880b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:02.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 shutdown_connections 2023-08-25T09:42:02.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.273+0000 7fa48cf99640 1 -- 172.21.15.89:0/3989851899 wait complete. 2023-08-25T09:42:02.285 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T09:42:02.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T09:42:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.386+0000 7fc7190a7640 1 Processor -- start 2023-08-25T09:42:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.386+0000 7fc7190a7640 1 -- start start 2023-08-25T09:42:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc7190a7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc7140b3b40 0x7fc7141427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc7190a7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7140b8580 con 0x7fc7140b8d10 2023-08-25T09:42:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc7190a7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7140b40f0 con 0x7fc71406aad0 2023-08-25T09:42:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc7190a7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140b4930 con 0x7fc7140b3b40 2023-08-25T09:42:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc70bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc7140b8d10 0x7fc714142090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33238/0 (socket says 172.21.15.89:33238) 2023-08-25T09:42:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc70bfff640 1 -- 172.21.15.89:0/3651071395 learned_addr learned my addr 172.21.15.89:0/3651071395 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:02.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71359e640 1 --2- 172.21.15.89:0/3651071395 >> v2:172.21.15.121:3300/0 conn(0x7fc7140b3b40 0x7fc7141427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196995791 0 0) 0x7fc7140b8580 con 0x7fc7140b8d10 2023-08-25T09:42:02.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc700003520 con 0x7fc7140b8d10 2023-08-25T09:42:02.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932135407 0 0) 0x7fc700003520 con 0x7fc7140b8d10 2023-08-25T09:42:02.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 >> v2:172.21.15.121:3300/0 conn(0x7fc7140b3b40 msgr2=0x7fc7141427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 --2- 172.21.15.89:0/3651071395 >> v2:172.21.15.121:3300/0 conn(0x7fc7140b3b40 0x7fc7141427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 >> v1:172.21.15.121:6789/0 conn(0x7fc71406aad0 legacy=0x7fc7140b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7140b87f0 con 0x7fc7140b8d10 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fc6fc001670 con 0x7fc7140b8d10 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71359e640 1 --2- 172.21.15.89:0/3651071395 >> v2:172.21.15.121:3300/0 conn(0x7fc7140b3b40 0x7fc7141427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 >> v1:172.21.15.89:6789/0 conn(0x7fc7140b8d10 legacy=0x7fc714142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc700003970 0x7fc700003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7000047c0 0x7fc700004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc70000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140b4930 con 0x7fc700005180 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70000c120 con 0x7fc7000047c0 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.387+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70000c2e0 con 0x7fc700003970 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc70000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc70bfff640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7000047c0 0x7fc700004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc712d9d640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc700003970 0x7fc700003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 -- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc700003970 msgr2=0x7fc700003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:02.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc700003970 0x7fc700003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 -- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7000047c0 msgr2=0x7fc700004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7000047c0 0x7fc700004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 -- 172.21.15.89:0/3651071395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700003520 con 0x7fc700005180 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.388+0000 7fc71359e640 1 -- 172.21.15.89:0/3651071395 reap_dead start 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc71359e640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc70000b980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00e350 tx=0x7fc7000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28366fb5fae71928 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c02ce00 con 0x7fc700005180 2023-08-25T09:42:02.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c00f040 con 0x7fc700005180 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc71259c640 1 -- 172.21.15.89:0/3651071395 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c003bd0 con 0x7fc700005180 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 -- 172.21.15.89:0/3651071395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 msgr2=0x7fc70000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc70000b980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00e350 tx=0x7fc7000057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 -- 172.21.15.89:0/3651071395 shutdown_connections 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 --2- 172.21.15.89:0/3651071395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc70000b980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 -- 172.21.15.89:0/3651071395 >> 172.21.15.89:0/3651071395 conn(0x7fc7140b91c0 msgr2=0x7fc7140b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:02.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 -- 172.21.15.89:0/3651071395 shutdown_connections 2023-08-25T09:42:02.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.389+0000 7fc7190a7640 1 -- 172.21.15.89:0/3651071395 wait complete. 2023-08-25T09:42:02.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.390+0000 7fc7190a7640 1 Processor -- start 2023-08-25T09:42:02.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.390+0000 7fc7190a7640 1 -- start start 2023-08-25T09:42:02.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc7190a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc714140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc7190a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714141350 0x7fc7141df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc7190a7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7141d1d10 0x7fc7141dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc7190a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141df530 con 0x7fc700005180 2023-08-25T09:42:02.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc7190a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141d2230 con 0x7fc714141350 2023-08-25T09:42:02.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc7190a7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141d2510 con 0x7fc7141d1d10 2023-08-25T09:42:02.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc714140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc714140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33672/0 (socket says 172.21.15.89:33672) 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 -- 172.21.15.89:0/949111741 learned_addr learned my addr 172.21.15.89:0/949111741 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc71359e640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7141d1d10 0x7fc7141dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc70bfff640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714141350 0x7fc7141df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 -- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7141d1d10 msgr2=0x7fc7141dff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7141d1d10 0x7fc7141dff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 -- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714141350 msgr2=0x7fc7141df9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:02.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714141350 0x7fc7141df9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 -- 172.21.15.89:0/949111741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7141d27f0 con 0x7fc700005180 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.391+0000 7fc712d9d640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc714140e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc70400f5f0 tx=0x7fc70400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.392+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040052e0 con 0x7fc700005180 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.392+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704005440 con 0x7fc700005180 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.392+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc714146340 con 0x7fc700005180 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.392+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704003810 con 0x7fc700005180 2023-08-25T09:42:02.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.392+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc714070d80 con 0x7fc700005180 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.393+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7141d2650 con 0x7fc700005180 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.393+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc704003970 con 0x7fc700005180 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.393+0000 7fc70b7fe640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc6f406a050 0x7fc6f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.393+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7040883f0 con 0x7fc700005180 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.394+0000 7fc70bfff640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc6f406a050 0x7fc6f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.394+0000 7fc70bfff640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc6f406a050 0x7fc6f406c510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc714071160 tx=0x7fc6fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:02.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.398+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc7141d2650 con 0x7fc700005180 2023-08-25T09:42:02.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:02.602+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7141df670 con 0x7fc700005180 2023-08-25T09:42:03.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.279+0000 7fc70b7fe640 1 -- 172.21.15.89:0/949111741 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7141df670 con 0x7fc700005180 2023-08-25T09:42:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.281+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc6f406a050 msgr2=0x7fc6f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.281+0000 7fc7190a7640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc6f406a050 0x7fc6f406c510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc714071160 tx=0x7fc6fc009040 comp rx=0 tx=0).stop 2023-08-25T09:42:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.281+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 msgr2=0x7fc714140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.281+0000 7fc7190a7640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc714140e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc70400f5f0 tx=0x7fc70400fab0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 shutdown_connections 2023-08-25T09:42:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc6f406a050 0x7fc6f406c510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7141d1d10 0x7fc7141dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc714141350 0x7fc7141df9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 --2- 172.21.15.89:0/949111741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc700005180 0x7fc714140e10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 >> 172.21.15.89:0/949111741 conn(0x7fc7140b91c0 msgr2=0x7fc7140b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 shutdown_connections 2023-08-25T09:42:03.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.282+0000 7fc7190a7640 1 -- 172.21.15.89:0/949111741 wait complete. 2023-08-25T09:42:03.299 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T09:42:03.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:03.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.399+0000 7fc1ffdf3640 1 Processor -- start 2023-08-25T09:42:03.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.399+0000 7fc1ffdf3640 1 -- start start 2023-08-25T09:42:03.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1ffdf3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1f8070120 0x7fc1f8070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1ffdf3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f806f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1ffdf3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc1f80b2e20 0x7fc1f81441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1ffdf3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f806ec00 con 0x7fc1f8070120 2023-08-25T09:42:03.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1ffdf3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f8070a40 con 0x7fc1f80b2e20 2023-08-25T09:42:03.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1ffdf3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f806f560 con 0x7fc1f8146f60 2023-08-25T09:42:03.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1fdb8f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1f8070120 0x7fc1f8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1fdb8f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1f8070120 0x7fc1f8070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33688/0 (socket says 172.21.15.89:33688) 2023-08-25T09:42:03.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.400+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/3052511105 learned_addr learned my addr 172.21.15.89:0/3052511105 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:03.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fe390640 1 --2- 172.21.15.89:0/3052511105 >> v2:172.21.15.121:3300/0 conn(0x7fc1f80b2e20 0x7fc1f81441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/3052511105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 msgr2=0x7fc1f806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:03.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fdb8f640 1 --2- 172.21.15.89:0/3052511105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/3052511105 >> v2:172.21.15.121:3300/0 conn(0x7fc1f80b2e20 msgr2=0x7fc1f81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:03.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fdb8f640 1 --2- 172.21.15.89:0/3052511105 >> v2:172.21.15.121:3300/0 conn(0x7fc1f80b2e20 0x7fc1f81441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/3052511105 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80b3530 con 0x7fc1f8070120 2023-08-25T09:42:03.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fdb8f640 1 --2- 172.21.15.89:0/3052511105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8070500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1f806ad60 tx=0x7fc1f402cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab01b5a34ea5669 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:03.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fcb8d640 1 -- 172.21.15.89:0/3052511105 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f402daf0 con 0x7fc1f8070120 2023-08-25T09:42:03.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fcb8d640 1 -- 172.21.15.89:0/3052511105 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f402dc50 con 0x7fc1f8070120 2023-08-25T09:42:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.401+0000 7fc1fcb8d640 1 -- 172.21.15.89:0/3052511105 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4035440 con 0x7fc1f8070120 2023-08-25T09:42:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/3052511105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 msgr2=0x7fc1f8070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/3052511105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8070500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1f806ad60 tx=0x7fc1f402cd40 comp rx=0 tx=0).stop 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/3052511105 shutdown_connections 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/3052511105 >> v2:172.21.15.121:3300/0 conn(0x7fc1f80b2e20 0x7fc1f81441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/3052511105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f806f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/3052511105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8070500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/3052511105 >> 172.21.15.89:0/3052511105 conn(0x7fc1f8069a30 msgr2=0x7fc1f8069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/3052511105 shutdown_connections 2023-08-25T09:42:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.402+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/3052511105 wait complete. 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.403+0000 7fc1ffdf3640 1 Processor -- start 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.403+0000 7fc1ffdf3640 1 -- start start 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1f80b2e20 0x7fc1f81dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f813a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8142970 con 0x7fc1f8070120 2023-08-25T09:42:03.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80b55b0 con 0x7fc1f80b2e20 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8142be0 con 0x7fc1f8146f60 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8141430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33692/0 (socket says 172.21.15.89:33692) 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/1424559209 learned_addr learned my addr 172.21.15.89:0/1424559209 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fd38e640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1f80b2e20 0x7fc1f81dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fe390640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f813a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 msgr2=0x7fc1f813a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f813a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1f80b2e20 msgr2=0x7fc1f81dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1f80b2e20 0x7fc1f81dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 -- 172.21.15.89:0/1424559209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f400a670 con 0x7fc1f8070120 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1fdb8f640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8141430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1f402cd80 tx=0x7fc1f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4040860 con 0x7fc1f8070120 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f40409e0 con 0x7fc1f8070120 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f80b5870 con 0x7fc1f8070120 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4040d90 con 0x7fc1f8070120 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.404+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f81e06e0 con 0x7fc1f8070120 2023-08-25T09:42:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.405+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f8142760 con 0x7fc1f8070120 2023-08-25T09:42:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.406+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc1f403c070 con 0x7fc1f8070120 2023-08-25T09:42:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.406+0000 7fc1ea7fc640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1dc06a080 0x7fc1dc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.406+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1f40aaeb0 con 0x7fc1f8070120 2023-08-25T09:42:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.406+0000 7fc1fd38e640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1dc06a080 0x7fc1dc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.407+0000 7fc1fd38e640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1dc06a080 0x7fc1dc06c540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1f813b7d0 tx=0x7fc1ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.410+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc1f8142760 con 0x7fc1f8070120 2023-08-25T09:42:03.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.612+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f8142760 con 0x7fc1f8070120 2023-08-25T09:42:03.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.612+0000 7fc1ea7fc640 1 -- 172.21.15.89:0/1424559209 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7fc1f8142760 con 0x7fc1f8070120 2023-08-25T09:42:03.615 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:03.615 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:03.616 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:03.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1dc06a080 msgr2=0x7fc1dc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1dc06a080 0x7fc1dc06c540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1f813b7d0 tx=0x7fc1ec008040 comp rx=0 tx=0).stop 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 msgr2=0x7fc1f8141430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8141430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1f402cd80 tx=0x7fc1f4004730 comp rx=0 tx=0).stop 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 shutdown_connections 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1dc06a080 0x7fc1dc06c540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1f8146f60 0x7fc1f813a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1f80b2e20 0x7fc1f81dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 --2- 172.21.15.89:0/1424559209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1f8070120 0x7fc1f8141430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 >> 172.21.15.89:0/1424559209 conn(0x7fc1f8069a30 msgr2=0x7fc1f8140930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:03.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 shutdown_connections 2023-08-25T09:42:03.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.614+0000 7fc1ffdf3640 1 -- 172.21.15.89:0/1424559209 wait complete. 2023-08-25T09:42:03.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:03.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 Processor -- start 2023-08-25T09:42:03.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 -- start start 2023-08-25T09:42:03.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f8c06abd0 0x7f8f8c0b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c153200 0x7f8f8c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8c14ae20 con 0x7f8f8c14a9e0 2023-08-25T09:42:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c06c9b0 con 0x7f8f8c06abd0 2023-08-25T09:42:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.724+0000 7f8f92b96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0b52a0 con 0x7f8f8c153200 2023-08-25T09:42:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f8c06abd0 0x7f8f8c0b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f8c06abd0 0x7f8f8c0b96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33706/0 (socket says 172.21.15.89:33706) 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f8bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8f8c14a9e0 0x7f8f8c14b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33240/0 (socket says 172.21.15.89:33240) 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 -- 172.21.15.89:0/3554519016 learned_addr learned my addr 172.21.15.89:0/3554519016 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f91133640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c153200 0x7f8f8c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 -- 172.21.15.89:0/3554519016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c153200 msgr2=0x7f8f8c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c153200 0x7f8f8c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 -- 172.21.15.89:0/3554519016 >> v1:172.21.15.89:6789/0 conn(0x7f8f8c14a9e0 legacy=0x7f8f8c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f90932640 1 -- 172.21.15.89:0/3554519016 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c0b4fc0 con 0x7f8f8c06abd0 2023-08-25T09:42:03.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f8b7fe640 1 -- 172.21.15.89:0/3554519016 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361115697 0 0) 0x7f8f8c14ae20 con 0x7f8f8c14a9e0 2023-08-25T09:42:03.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.725+0000 7f8f91133640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c153200 0x7f8f8c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:03.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f90932640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c06abd0 0x7f8f8c0b96c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009e50 tx=0x7f8f8402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1645ed823c8688 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:03.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f8b7fe640 1 -- 172.21.15.89:0/3554519016 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8402cb00 con 0x7f8f8c06abd0 2023-08-25T09:42:03.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f8b7fe640 1 -- 172.21.15.89:0/3554519016 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8402cc60 con 0x7f8f8c06abd0 2023-08-25T09:42:03.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f8b7fe640 1 -- 172.21.15.89:0/3554519016 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840343f0 con 0x7f8f8c06abd0 2023-08-25T09:42:03.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 -- 172.21.15.89:0/3554519016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c06abd0 msgr2=0x7f8f8c0b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c06abd0 0x7f8f8c0b96c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009e50 tx=0x7f8f8402bf60 comp rx=0 tx=0).stop 2023-08-25T09:42:03.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 -- 172.21.15.89:0/3554519016 shutdown_connections 2023-08-25T09:42:03.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c153200 0x7f8f8c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 --2- 172.21.15.89:0/3554519016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c06abd0 0x7f8f8c0b96c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 -- 172.21.15.89:0/3554519016 >> 172.21.15.89:0/3554519016 conn(0x7f8f8c0bab60 msgr2=0x7f8f8c0baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:03.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 -- 172.21.15.89:0/3554519016 shutdown_connections 2023-08-25T09:42:03.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.726+0000 7f8f92b96640 1 -- 172.21.15.89:0/3554519016 wait complete. 2023-08-25T09:42:03.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.727+0000 7f8f92b96640 1 Processor -- start 2023-08-25T09:42:03.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.727+0000 7f8f92b96640 1 -- start start 2023-08-25T09:42:03.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f92b96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f8c06abd0 0x7f8f8c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f92b96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c14a9e0 0x7f8f8c13f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f92b96640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 0x7f8f8c0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f92b96640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c143430 con 0x7f8f8c153200 2023-08-25T09:42:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f92b96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0b6650 con 0x7f8f8c06abd0 2023-08-25T09:42:03.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f92b96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0b5480 con 0x7f8f8c14a9e0 2023-08-25T09:42:03.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 0x7f8f8c0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 0x7f8f8c0b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33714/0 (socket says 172.21.15.89:33714) 2023-08-25T09:42:03.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 -- 172.21.15.89:0/667075386 learned_addr learned my addr 172.21.15.89:0/667075386 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:03.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 -- 172.21.15.89:0/667075386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c14a9e0 msgr2=0x7f8f8c13f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c14a9e0 0x7f8f8c13f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 -- 172.21.15.89:0/667075386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f8c06abd0 msgr2=0x7f8f8c0b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f8c06abd0 0x7f8f8c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.728+0000 7f8f91133640 1 -- 172.21.15.89:0/667075386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84009b30 con 0x7f8f8c153200 2023-08-25T09:42:03.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.729+0000 7f8f91133640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 0x7f8f8c0b6db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c5f0 tx=0x7f8f7400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:03.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.729+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011800 con 0x7f8f8c153200 2023-08-25T09:42:03.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.729+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74011980 con 0x7f8f8c153200 2023-08-25T09:42:03.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.729+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c0b5760 con 0x7f8f8c153200 2023-08-25T09:42:03.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.729+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011d30 con 0x7f8f8c153200 2023-08-25T09:42:03.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.729+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c13f640 con 0x7f8f8c153200 2023-08-25T09:42:03.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.730+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c073bf0 con 0x7f8f8c153200 2023-08-25T09:42:03.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.730+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8f74022350 con 0x7f8f8c153200 2023-08-25T09:42:03.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.730+0000 7f8f897fa640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8f6c06a050 0x7f8f6c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:03.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.731+0000 7f8f90932640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8f6c06a050 0x7f8f6c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:03.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.731+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f74088640 con 0x7f8f8c153200 2023-08-25T09:42:03.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.731+0000 7f8f90932640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8f6c06a050 0x7f8f6c06c510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f84035000 tx=0x7f8f8402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:03.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.735+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8f74053d40 con 0x7f8f8c153200 2023-08-25T09:42:03.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.899+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f8c0b5950 con 0x7f8f8c153200 2023-08-25T09:42:03.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.901+0000 7f8f897fa640 1 -- 172.21.15.89:0/667075386 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f8f74057360 con 0x7f8f8c153200 2023-08-25T09:42:03.902 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:03.903 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:03.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.902+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8f6c06a050 msgr2=0x7f8f6c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.902+0000 7f8f92b96640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8f6c06a050 0x7f8f6c06c510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f84035000 tx=0x7f8f8402e000 comp rx=0 tx=0).stop 2023-08-25T09:42:03.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.902+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 msgr2=0x7f8f8c0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:03.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.902+0000 7f8f92b96640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 0x7f8f8c0b6db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c5f0 tx=0x7f8f7400cab0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 shutdown_connections 2023-08-25T09:42:03.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8f6c06a050 0x7f8f6c06c510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f8c153200 0x7f8f8c0b6db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f8c14a9e0 0x7f8f8c13f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 --2- 172.21.15.89:0/667075386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f8c06abd0 0x7f8f8c0b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:03.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 >> 172.21.15.89:0/667075386 conn(0x7f8f8c0bab60 msgr2=0x7f8f8c141530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:03.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 shutdown_connections 2023-08-25T09:42:03.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:03.903+0000 7f8f92b96640 1 -- 172.21.15.89:0/667075386 wait complete. 2023-08-25T09:42:03.915 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T09:42:03.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:04.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.013+0000 7f789174e640 1 Processor -- start 2023-08-25T09:42:04.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.013+0000 7f789174e640 1 -- start start 2023-08-25T09:42:04.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f789174e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f788c06abd0 0x7f788c0b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f789174e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f789174e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f788c14b680 0x7f788c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f789174e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c06c9b0 con 0x7f788c06abd0 2023-08-25T09:42:04.016 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f789174e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c0b52a0 con 0x7f788c14b680 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f789174e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c06bfb0 con 0x7f788c14a9e0 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f788c06abd0 0x7f788c0b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f788c06abd0 0x7f788c0b96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33728/0 (socket says 172.21.15.89:33728) 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 -- 172.21.15.89:0/2789420370 learned_addr learned my addr 172.21.15.89:0/2789420370 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788a7fc640 1 --2- 172.21.15.89:0/2789420370 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788b7fe640 1 --2- 172.21.15.89:0/2789420370 >> v2:172.21.15.121:3300/0 conn(0x7f788c14b680 0x7f788c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 -- 172.21.15.89:0/2789420370 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 msgr2=0x7f788c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:04.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 --2- 172.21.15.89:0/2789420370 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 -- 172.21.15.89:0/2789420370 >> v2:172.21.15.121:3300/0 conn(0x7f788c14b680 msgr2=0x7f788c14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:04.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 --2- 172.21.15.89:0/2789420370 >> v2:172.21.15.121:3300/0 conn(0x7f788c14b680 0x7f788c14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.014+0000 7f788affd640 1 -- 172.21.15.89:0/2789420370 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c14ae20 con 0x7f788c06abd0 2023-08-25T09:42:04.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f788affd640 1 --2- 172.21.15.89:0/2789420370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c06abd0 0x7f788c0b96c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f788c0ba2d0 tx=0x7f787c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3afa9195451b360 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f7889ffb640 1 -- 172.21.15.89:0/2789420370 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c031640 con 0x7f788c06abd0 2023-08-25T09:42:04.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f7889ffb640 1 -- 172.21.15.89:0/2789420370 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c0317a0 con 0x7f788c06abd0 2023-08-25T09:42:04.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f7889ffb640 1 -- 172.21.15.89:0/2789420370 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c031b30 con 0x7f788c06abd0 2023-08-25T09:42:04.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 -- 172.21.15.89:0/2789420370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c06abd0 msgr2=0x7f788c0b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 --2- 172.21.15.89:0/2789420370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c06abd0 0x7f788c0b96c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f788c0ba2d0 tx=0x7f787c02b8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 -- 172.21.15.89:0/2789420370 shutdown_connections 2023-08-25T09:42:04.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 --2- 172.21.15.89:0/2789420370 >> v2:172.21.15.121:3300/0 conn(0x7f788c14b680 0x7f788c14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 --2- 172.21.15.89:0/2789420370 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 --2- 172.21.15.89:0/2789420370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c06abd0 0x7f788c0b96c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.015+0000 7f789174e640 1 -- 172.21.15.89:0/2789420370 >> 172.21.15.89:0/2789420370 conn(0x7f788c0bab60 msgr2=0x7f788c0baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:04.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.016+0000 7f789174e640 1 -- 172.21.15.89:0/2789420370 shutdown_connections 2023-08-25T09:42:04.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.016+0000 7f789174e640 1 -- 172.21.15.89:0/2789420370 wait complete. 2023-08-25T09:42:04.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 Processor -- start 2023-08-25T09:42:04.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 -- start start 2023-08-25T09:42:04.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f788c06abd0 0x7f788c142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 0x7f788c145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c143040 con 0x7f788c14b680 2023-08-25T09:42:04.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0b68c0 con 0x7f788c06abd0 2023-08-25T09:42:04.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f789174e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0b6ba0 con 0x7f788c14a9e0 2023-08-25T09:42:04.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f788b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 0x7f788c145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f788b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 0x7f788c145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33742/0 (socket says 172.21.15.89:33742) 2023-08-25T09:42:04.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.017+0000 7f788b7fe640 1 -- 172.21.15.89:0/2982462890 learned_addr learned my addr 172.21.15.89:0/2982462890 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:04.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788affd640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f788c06abd0 0x7f788c142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788a7fc640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788b7fe640 1 -- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 msgr2=0x7f788c147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788b7fe640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788b7fe640 1 -- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f788c06abd0 msgr2=0x7f788c142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788b7fe640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f788c06abd0 0x7f788c142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788b7fe640 1 -- 172.21.15.89:0/2982462890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0094d0 con 0x7f788c14b680 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788a7fc640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f788b7fe640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 0x7f788c145100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7884009fd0 tx=0x7f788400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884014420 con 0x7f788c14b680 2023-08-25T09:42:04.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884014580 con 0x7f788c14b680 2023-08-25T09:42:04.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c0b6e80 con 0x7f788c14b680 2023-08-25T09:42:04.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884014930 con 0x7f788c14b680 2023-08-25T09:42:04.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.018+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c0b6430 con 0x7f788c14b680 2023-08-25T09:42:04.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.019+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c073bf0 con 0x7f788c14b680 2023-08-25T09:42:04.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.019+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7884014a90 con 0x7f788c14b680 2023-08-25T09:42:04.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.020+0000 7f78737fe640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f787806a050 0x7f787806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.020+0000 7f788affd640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f787806a050 0x7f787806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.020+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7884088dc0 con 0x7f788c14b680 2023-08-25T09:42:04.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.020+0000 7f788affd640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f787806a050 0x7f787806c510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f787c036000 tx=0x7f787c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.024+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7884057fd0 con 0x7f788c14b680 2023-08-25T09:42:04.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.186+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f788c0b91a0 con 0x7f787806a050 2023-08-25T09:42:04.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.193+0000 7f78737fe640 1 -- 172.21.15.89:0/2982462890 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271997 (secure 0 0 0) 0x7f787c044400 con 0x7f787806a050 2023-08-25T09:42:04.198 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:04.199 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:04.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f787806a050 msgr2=0x7f787806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f787806a050 0x7f787806c510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f787c036000 tx=0x7f787c03c040 comp rx=0 tx=0).stop 2023-08-25T09:42:04.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 msgr2=0x7f788c145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 0x7f788c145100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7884009fd0 tx=0x7f788400e4b0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 shutdown_connections 2023-08-25T09:42:04.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f787806a050 0x7f787806c510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f788c14b680 0x7f788c145100 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f788c14a9e0 0x7f788c147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 --2- 172.21.15.89:0/2982462890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f788c06abd0 0x7f788c142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.196+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 >> 172.21.15.89:0/2982462890 conn(0x7f788c0bab60 msgr2=0x7f788c149840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:04.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.197+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 shutdown_connections 2023-08-25T09:42:04.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.197+0000 7f789174e640 1 -- 172.21.15.89:0/2982462890 wait complete. 2023-08-25T09:42:04.209 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-08-25T09:42:02.500219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218840,"kb_used_data":2640,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755880,"statfs":{"total":773094113280,"available":772870021120,"internally_reserved":0,"allocated":2703360,"data_stored":1673464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000712"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.842368+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:41:57.842368+0000","last_peered":"2023-08-25T09:41:57.842368+0000","last_clean":"2023-08-25T09:41:57.842368+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:41:57.842368+0000","last_undegraded":"2023-08-25T09:41:57.842368+0000","last_fullsized":"2023-08-25T09:41:57.842368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:40:26.284698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.842667+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:41:57.842667+0000","last_peered":"2023-08-25T09:41:57.842667+0000","last_clean":"2023-08-25T09:41:57.842667+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:41:57.842667+0000","last_undegraded":"2023-08-25T09:41:57.842667+0000","last_fullsized":"2023-08-25T09:41:57.842667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:55:52.594678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.842469+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:41:57.842469+0000","last_peered":"2023-08-25T09:41:57.842469+0000","last_clean":"2023-08-25T09:41:57.842469+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:41:57.842469+0000","last_undegraded":"2023-08-25T09:41:57.842469+0000","last_fullsized":"2023-08-25T09:41:57.842469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:33:50.677535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.841524+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:41:57.841524+0000","last_peered":"2023-08-25T09:41:57.841524+0000","last_clean":"2023-08-25T09:41:57.841524+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:41:57.841524+0000","last_undegraded":"2023-08-25T09:41:57.841524+0000","last_fullsized":"2023-08-25T09:41:57.841524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:16:03.874154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.842633+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:41:57.842633+0000","last_peered":"2023-08-25T09:41:57.842633+0000","last_clean":"2023-08-25T09:41:57.842633+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:41:57.842633+0000","last_undegraded":"2023-08-25T09:41:57.842633+0000","last_fullsized":"2023-08-25T09:41:57.842633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:27:40.864418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.841653+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:41:57.841653+0000","last_peered":"2023-08-25T09:41:57.841653+0000","last_clean":"2023-08-25T09:41:57.841653+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:41:57.841653+0000","last_undegraded":"2023-08-25T09:41:57.841653+0000","last_fullsized":"2023-08-25T09:41:57.841653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:27:40.864418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.842517+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:41:57.842517+0000","last_peered":"2023-08-25T09:41:57.842517+0000","last_clean":"2023-08-25T09:41:57.842517+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:41:57.842517+0000","last_undegraded":"2023-08-25T09:41:57.842517+0000","last_fullsized":"2023-08-25T09:41:57.842517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:01.401278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.841697+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:41:57.841697+0000","last_peered":"2023-08-25T09:41:57.841697+0000","last_clean":"2023-08-25T09:41:57.841697+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:41:57.841697+0000","last_undegraded":"2023-08-25T09:41:57.841697+0000","last_fullsized":"2023-08-25T09:41:57.841697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:55:52.594678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-25T09:41:57.842200+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:41:57.842200+0000","last_peered":"2023-08-25T09:41:57.842200+0000","last_clean":"2023-08-25T09:41:57.842200+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:41:57.842200+0000","last_undegraded":"2023-08-25T09:41:57.842200+0000","last_fullsized":"2023-08-25T09:41:57.842200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:28:40.045804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:42:00.233266+0000","last_change":"2023-08-25T09:42:00.233266+0000","last_active":"2023-08-25T09:42:00.233266+0000","last_peered":"2023-08-25T09:42:00.233266+0000","last_clean":"2023-08-25T09:42:00.233266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:00.233266+0000","last_undegraded":"2023-08-25T09:42:00.233266+0000","last_fullsized":"2023-08-25T09:42:00.233266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T09:41:59.229426+0000","last_change":"2023-08-25T09:41:59.229426+0000","last_active":"2023-08-25T09:41:59.229426+0000","last_peered":"2023-08-25T09:41:59.229426+0000","last_clean":"2023-08-25T09:41:59.229426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:41:59.229426+0000","last_undegraded":"2023-08-25T09:41:59.229426+0000","last_fullsized":"2023-08-25T09:41:59.229426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:04.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:04.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.347+0000 7fc2bb54e640 1 Processor -- start 2023-08-25T09:42:04.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.347+0000 7fc2bb54e640 1 -- start start 2023-08-25T09:42:04.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2bb54e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2b4070c30 0x7fc2b40b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2bb54e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc2b406f480 0x7fc2b40b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2bb54e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b4071740 con 0x7fc2b4065760 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2bb54e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40b87b0 con 0x7fc2b4070c30 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2bb54e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40bd700 con 0x7fc2b406f480 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2b4070c30 0x7fc2b40b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2b4070c30 0x7fc2b40b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33758/0 (socket says 172.21.15.89:33758) 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 -- 172.21.15.89:0/3922751495 learned_addr learned my addr 172.21.15.89:0/3922751495 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:04.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 -- 172.21.15.89:0/3922751495 >> v2:172.21.15.121:3300/0 conn(0x7fc2b406f480 msgr2=0x7fc2b40b8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 --2- 172.21.15.89:0/3922751495 >> v2:172.21.15.121:3300/0 conn(0x7fc2b406f480 0x7fc2b40b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 -- 172.21.15.89:0/3922751495 >> v1:172.21.15.121:6789/0 conn(0x7fc2b4065760 legacy=0x7fc2b4142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.348+0000 7fc2b8ae9640 1 -- 172.21.15.89:0/3922751495 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4071180 con 0x7fc2b4070c30 2023-08-25T09:42:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2b8ae9640 1 --2- 172.21.15.89:0/3922751495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b40b80a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc2b406b8f0 tx=0x7fc2a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a2b819b3423e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2abfff640 1 -- 172.21.15.89:0/3922751495 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4030860 con 0x7fc2b4070c30 2023-08-25T09:42:04.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2abfff640 1 -- 172.21.15.89:0/3922751495 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a40309c0 con 0x7fc2b4070c30 2023-08-25T09:42:04.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2abfff640 1 -- 172.21.15.89:0/3922751495 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4030d50 con 0x7fc2b4070c30 2023-08-25T09:42:04.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 -- 172.21.15.89:0/3922751495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 msgr2=0x7fc2b40b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/3922751495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b40b80a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc2b406b8f0 tx=0x7fc2a402b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 -- 172.21.15.89:0/3922751495 shutdown_connections 2023-08-25T09:42:04.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/3922751495 >> v2:172.21.15.121:3300/0 conn(0x7fc2b406f480 0x7fc2b40b8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/3922751495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b40b80a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 -- 172.21.15.89:0/3922751495 >> 172.21.15.89:0/3922751495 conn(0x7fc2b4069850 msgr2=0x7fc2b4069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:04.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 -- 172.21.15.89:0/3922751495 shutdown_connections 2023-08-25T09:42:04.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.349+0000 7fc2bb54e640 1 -- 172.21.15.89:0/3922751495 wait complete. 2023-08-25T09:42:04.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.350+0000 7fc2bb54e640 1 Processor -- start 2023-08-25T09:42:04.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.350+0000 7fc2bb54e640 1 -- start start 2023-08-25T09:42:04.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2bb54e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b4065760 0x7fc2b41d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2bb54e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2b406f480 0x7fc2b41d2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2bb54e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b41d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2bb54e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b41d57c0 con 0x7fc2b4070c30 2023-08-25T09:42:04.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2bb54e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b41d2560 con 0x7fc2b4065760 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2bb54e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b41d1fa0 con 0x7fc2b406f480 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b41d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b41d31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33770/0 (socket says 172.21.15.89:33770) 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 -- 172.21.15.89:0/2155445042 learned_addr learned my addr 172.21.15.89:0/2155445042 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b8ae9640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2b406f480 0x7fc2b41d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b92ea640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b4065760 0x7fc2b41d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 -- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2b406f480 msgr2=0x7fc2b41d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2b406f480 0x7fc2b41d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 -- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b4065760 msgr2=0x7fc2b41d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b4065760 0x7fc2b41d4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 -- 172.21.15.89:0/2155445042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40094d0 con 0x7fc2b4070c30 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b8ae9640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2b406f480 0x7fc2b41d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b92ea640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b4065760 0x7fc2b41d4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.351+0000 7fc2b9aeb640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b41d31d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00b970 tx=0x7fc2ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.352+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00cb40 con 0x7fc2b4070c30 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.352+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00ccc0 con 0x7fc2b4070c30 2023-08-25T09:42:04.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.352+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b41d2280 con 0x7fc2b4070c30 2023-08-25T09:42:04.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.352+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac014680 con 0x7fc2b4070c30 2023-08-25T09:42:04.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.352+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b4149050 con 0x7fc2b4070c30 2023-08-25T09:42:04.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.353+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b41d1dd0 con 0x7fc2b4070c30 2023-08-25T09:42:04.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.353+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc2ac01d3b0 con 0x7fc2b4070c30 2023-08-25T09:42:04.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.353+0000 7fc2a9ffb640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc29806a050 0x7fc29806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.353+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2ac0884f0 con 0x7fc2b4070c30 2023-08-25T09:42:04.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.354+0000 7fc2b92ea640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc29806a050 0x7fc29806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.354+0000 7fc2b92ea640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc29806a050 0x7fc29806c510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0007fd0 tx=0x7fc2b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.357+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc2ac057670 con 0x7fc2b4070c30 2023-08-25T09:42:04.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.520+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2b41d2110 con 0x7fc29806a050 2023-08-25T09:42:04.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.527+0000 7fc2a9ffb640 1 -- 172.21.15.89:0/2155445042 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286703 (secure 0 0 0) 0x7fc2b41d2110 con 0x7fc29806a050 2023-08-25T09:42:04.535 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:04.537 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:04.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc29806a050 msgr2=0x7fc29806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc29806a050 0x7fc29806c510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0007fd0 tx=0x7fc2b0009040 comp rx=0 tx=0).stop 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 msgr2=0x7fc2b41d31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b41d31d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00b970 tx=0x7fc2ac00be30 comp rx=0 tx=0).stop 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 shutdown_connections 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc29806a050 0x7fc29806c510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2b4070c30 0x7fc2b41d31d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2b406f480 0x7fc2b41d2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 --2- 172.21.15.89:0/2155445042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b4065760 0x7fc2b41d4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 >> 172.21.15.89:0/2155445042 conn(0x7fc2b4069850 msgr2=0x7fc2b4141260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:04.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 shutdown_connections 2023-08-25T09:42:04.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.530+0000 7fc2bb54e640 1 -- 172.21.15.89:0/2155445042 wait complete. 2023-08-25T09:42:04.543 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T09:42:04.500571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219236,"kb_used_data":3052,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755484,"statfs":{"total":773094113280,"available":772869615616,"internally_reserved":0,"allocated":3125248,"data_stored":1869083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.266409"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336246+0000","last_change":"2023-08-25T09:42:01.258799+0000","last_active":"2023-08-25T09:42:02.336246+0000","last_peered":"2023-08-25T09:42:02.336246+0000","last_clean":"2023-08-25T09:42:02.336246+0000","last_became_active":"2023-08-25T09:42:01.258539+0000","last_became_peered":"2023-08-25T09:42:01.258539+0000","last_unstale":"2023-08-25T09:42:02.336246+0000","last_undegraded":"2023-08-25T09:42:02.336246+0000","last_fullsized":"2023-08-25T09:42:02.336246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:12:38.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142643+0000","last_change":"2023-08-25T09:42:01.264542+0000","last_active":"2023-08-25T09:42:03.142643+0000","last_peered":"2023-08-25T09:42:03.142643+0000","last_clean":"2023-08-25T09:42:03.142643+0000","last_became_active":"2023-08-25T09:42:01.264347+0000","last_became_peered":"2023-08-25T09:42:01.264347+0000","last_unstale":"2023-08-25T09:42:03.142643+0000","last_undegraded":"2023-08-25T09:42:03.142643+0000","last_fullsized":"2023-08-25T09:42:03.142643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258291+0000","last_change":"2023-08-25T09:42:01.257154+0000","last_active":"2023-08-25T09:42:02.258291+0000","last_peered":"2023-08-25T09:42:02.258291+0000","last_clean":"2023-08-25T09:42:02.258291+0000","last_became_active":"2023-08-25T09:42:01.256873+0000","last_became_peered":"2023-08-25T09:42:01.256873+0000","last_unstale":"2023-08-25T09:42:02.258291+0000","last_undegraded":"2023-08-25T09:42:02.258291+0000","last_fullsized":"2023-08-25T09:42:02.258291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:51.558349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142554+0000","last_change":"2023-08-25T09:42:01.257367+0000","last_active":"2023-08-25T09:42:03.142554+0000","last_peered":"2023-08-25T09:42:03.142554+0000","last_clean":"2023-08-25T09:42:03.142554+0000","last_became_active":"2023-08-25T09:42:01.257057+0000","last_became_peered":"2023-08-25T09:42:01.257057+0000","last_unstale":"2023-08-25T09:42:03.142554+0000","last_undegraded":"2023-08-25T09:42:03.142554+0000","last_fullsized":"2023-08-25T09:42:03.142554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:05:40.940630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728702+0000","last_change":"2023-08-25T09:42:01.267922+0000","last_active":"2023-08-25T09:42:02.728702+0000","last_peered":"2023-08-25T09:42:02.728702+0000","last_clean":"2023-08-25T09:42:02.728702+0000","last_became_active":"2023-08-25T09:42:01.267659+0000","last_became_peered":"2023-08-25T09:42:01.267659+0000","last_unstale":"2023-08-25T09:42:02.728702+0000","last_undegraded":"2023-08-25T09:42:02.728702+0000","last_fullsized":"2023-08-25T09:42:02.728702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257835+0000","last_change":"2023-08-25T09:42:01.259471+0000","last_active":"2023-08-25T09:42:02.257835+0000","last_peered":"2023-08-25T09:42:02.257835+0000","last_clean":"2023-08-25T09:42:02.257835+0000","last_became_active":"2023-08-25T09:42:01.259153+0000","last_became_peered":"2023-08-25T09:42:01.259153+0000","last_unstale":"2023-08-25T09:42:02.257835+0000","last_undegraded":"2023-08-25T09:42:02.257835+0000","last_fullsized":"2023-08-25T09:42:02.257835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143444+0000","last_change":"2023-08-25T09:42:01.256881+0000","last_active":"2023-08-25T09:42:03.143444+0000","last_peered":"2023-08-25T09:42:03.143444+0000","last_clean":"2023-08-25T09:42:03.143444+0000","last_became_active":"2023-08-25T09:42:01.256614+0000","last_became_peered":"2023-08-25T09:42:01.256614+0000","last_unstale":"2023-08-25T09:42:03.143444+0000","last_undegraded":"2023-08-25T09:42:03.143444+0000","last_fullsized":"2023-08-25T09:42:03.143444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:51.558349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142267+0000","last_change":"2023-08-25T09:42:01.254639+0000","last_active":"2023-08-25T09:42:03.142267+0000","last_peered":"2023-08-25T09:42:03.142267+0000","last_clean":"2023-08-25T09:42:03.142267+0000","last_became_active":"2023-08-25T09:42:01.254372+0000","last_became_peered":"2023-08-25T09:42:01.254372+0000","last_unstale":"2023-08-25T09:42:03.142267+0000","last_undegraded":"2023-08-25T09:42:03.142267+0000","last_fullsized":"2023-08-25T09:42:03.142267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728688+0000","last_change":"2023-08-25T09:42:01.267841+0000","last_active":"2023-08-25T09:42:02.728688+0000","last_peered":"2023-08-25T09:42:02.728688+0000","last_clean":"2023-08-25T09:42:02.728688+0000","last_became_active":"2023-08-25T09:42:01.267577+0000","last_became_peered":"2023-08-25T09:42:01.267577+0000","last_unstale":"2023-08-25T09:42:02.728688+0000","last_undegraded":"2023-08-25T09:42:02.728688+0000","last_fullsized":"2023-08-25T09:42:02.728688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:00.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142787+0000","last_change":"2023-08-25T09:42:01.261973+0000","last_active":"2023-08-25T09:42:03.142787+0000","last_peered":"2023-08-25T09:42:03.142787+0000","last_clean":"2023-08-25T09:42:03.142787+0000","last_became_active":"2023-08-25T09:42:01.261680+0000","last_became_peered":"2023-08-25T09:42:01.261680+0000","last_unstale":"2023-08-25T09:42:03.142787+0000","last_undegraded":"2023-08-25T09:42:03.142787+0000","last_fullsized":"2023-08-25T09:42:03.142787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258455+0000","last_change":"2023-08-25T09:42:01.259665+0000","last_active":"2023-08-25T09:42:02.258455+0000","last_peered":"2023-08-25T09:42:02.258455+0000","last_clean":"2023-08-25T09:42:02.258455+0000","last_became_active":"2023-08-25T09:42:01.258452+0000","last_became_peered":"2023-08-25T09:42:01.258452+0000","last_unstale":"2023-08-25T09:42:02.258455+0000","last_undegraded":"2023-08-25T09:42:02.258455+0000","last_fullsized":"2023-08-25T09:42:02.258455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:22:27.508892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336194+0000","last_change":"2023-08-25T09:42:01.252618+0000","last_active":"2023-08-25T09:42:02.336194+0000","last_peered":"2023-08-25T09:42:02.336194+0000","last_clean":"2023-08-25T09:42:02.336194+0000","last_became_active":"2023-08-25T09:42:01.252376+0000","last_became_peered":"2023-08-25T09:42:01.252376+0000","last_unstale":"2023-08-25T09:42:02.336194+0000","last_undegraded":"2023-08-25T09:42:02.336194+0000","last_fullsized":"2023-08-25T09:42:02.336194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:19:44.292634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336119+0000","last_change":"2023-08-25T09:42:01.262167+0000","last_active":"2023-08-25T09:42:02.336119+0000","last_peered":"2023-08-25T09:42:02.336119+0000","last_clean":"2023-08-25T09:42:02.336119+0000","last_became_active":"2023-08-25T09:42:01.261920+0000","last_became_peered":"2023-08-25T09:42:01.261920+0000","last_unstale":"2023-08-25T09:42:02.336119+0000","last_undegraded":"2023-08-25T09:42:02.336119+0000","last_fullsized":"2023-08-25T09:42:02.336119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:08:36.747182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142597+0000","last_change":"2023-08-25T09:42:01.260457+0000","last_active":"2023-08-25T09:42:03.142597+0000","last_peered":"2023-08-25T09:42:03.142597+0000","last_clean":"2023-08-25T09:42:03.142597+0000","last_became_active":"2023-08-25T09:42:01.260183+0000","last_became_peered":"2023-08-25T09:42:01.260183+0000","last_unstale":"2023-08-25T09:42:03.142597+0000","last_undegraded":"2023-08-25T09:42:03.142597+0000","last_fullsized":"2023-08-25T09:42:03.142597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143571+0000","last_change":"2023-08-25T09:42:01.259993+0000","last_active":"2023-08-25T09:42:03.143571+0000","last_peered":"2023-08-25T09:42:03.143571+0000","last_clean":"2023-08-25T09:42:03.143571+0000","last_became_active":"2023-08-25T09:42:01.259579+0000","last_became_peered":"2023-08-25T09:42:01.259579+0000","last_unstale":"2023-08-25T09:42:03.143571+0000","last_undegraded":"2023-08-25T09:42:03.143571+0000","last_fullsized":"2023-08-25T09:42:03.143571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:05.612344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257642+0000","last_change":"2023-08-25T09:42:01.257372+0000","last_active":"2023-08-25T09:42:02.257642+0000","last_peered":"2023-08-25T09:42:02.257642+0000","last_clean":"2023-08-25T09:42:02.257642+0000","last_became_active":"2023-08-25T09:42:01.257077+0000","last_became_peered":"2023-08-25T09:42:01.257077+0000","last_unstale":"2023-08-25T09:42:02.257642+0000","last_undegraded":"2023-08-25T09:42:02.257642+0000","last_fullsized":"2023-08-25T09:42:02.257642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728745+0000","last_change":"2023-08-25T09:42:01.267837+0000","last_active":"2023-08-25T09:42:02.728745+0000","last_peered":"2023-08-25T09:42:02.728745+0000","last_clean":"2023-08-25T09:42:02.728745+0000","last_became_active":"2023-08-25T09:42:01.267563+0000","last_became_peered":"2023-08-25T09:42:01.267563+0000","last_unstale":"2023-08-25T09:42:02.728745+0000","last_undegraded":"2023-08-25T09:42:02.728745+0000","last_fullsized":"2023-08-25T09:42:02.728745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258405+0000","last_change":"2023-08-25T09:42:01.251722+0000","last_active":"2023-08-25T09:42:02.258405+0000","last_peered":"2023-08-25T09:42:02.258405+0000","last_clean":"2023-08-25T09:42:02.258405+0000","last_became_active":"2023-08-25T09:42:01.251444+0000","last_became_peered":"2023-08-25T09:42:01.251444+0000","last_unstale":"2023-08-25T09:42:02.258405+0000","last_undegraded":"2023-08-25T09:42:02.258405+0000","last_fullsized":"2023-08-25T09:42:02.258405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:50.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336188+0000","last_change":"2023-08-25T09:42:01.256422+0000","last_active":"2023-08-25T09:42:02.336188+0000","last_peered":"2023-08-25T09:42:02.336188+0000","last_clean":"2023-08-25T09:42:02.336188+0000","last_became_active":"2023-08-25T09:42:01.256143+0000","last_became_peered":"2023-08-25T09:42:01.256143+0000","last_unstale":"2023-08-25T09:42:02.336188+0000","last_undegraded":"2023-08-25T09:42:02.336188+0000","last_fullsized":"2023-08-25T09:42:02.336188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:42:37.275739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258100+0000","last_change":"2023-08-25T09:42:01.254888+0000","last_active":"2023-08-25T09:42:02.258100+0000","last_peered":"2023-08-25T09:42:02.258100+0000","last_clean":"2023-08-25T09:42:02.258100+0000","last_became_active":"2023-08-25T09:42:01.254618+0000","last_became_peered":"2023-08-25T09:42:01.254618+0000","last_unstale":"2023-08-25T09:42:02.258100+0000","last_undegraded":"2023-08-25T09:42:02.258100+0000","last_fullsized":"2023-08-25T09:42:02.258100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143782+0000","last_change":"2023-08-25T09:42:01.262256+0000","last_active":"2023-08-25T09:42:03.143782+0000","last_peered":"2023-08-25T09:42:03.143782+0000","last_clean":"2023-08-25T09:42:03.143782+0000","last_became_active":"2023-08-25T09:42:01.261965+0000","last_became_peered":"2023-08-25T09:42:01.261965+0000","last_unstale":"2023-08-25T09:42:03.143782+0000","last_undegraded":"2023-08-25T09:42:03.143782+0000","last_fullsized":"2023-08-25T09:42:03.143782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:15.095999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728348+0000","last_change":"2023-08-25T09:42:01.265542+0000","last_active":"2023-08-25T09:42:02.728348+0000","last_peered":"2023-08-25T09:42:02.728348+0000","last_clean":"2023-08-25T09:42:02.728348+0000","last_became_active":"2023-08-25T09:42:01.265296+0000","last_became_peered":"2023-08-25T09:42:01.265296+0000","last_unstale":"2023-08-25T09:42:02.728348+0000","last_undegraded":"2023-08-25T09:42:02.728348+0000","last_fullsized":"2023-08-25T09:42:02.728348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253971+0000","last_change":"2023-08-25T09:42:01.263034+0000","last_active":"2023-08-25T09:42:02.253971+0000","last_peered":"2023-08-25T09:42:02.253971+0000","last_clean":"2023-08-25T09:42:02.253971+0000","last_became_active":"2023-08-25T09:42:01.262773+0000","last_became_peered":"2023-08-25T09:42:01.262773+0000","last_unstale":"2023-08-25T09:42:02.253971+0000","last_undegraded":"2023-08-25T09:42:02.253971+0000","last_fullsized":"2023-08-25T09:42:02.253971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143207+0000","last_change":"2023-08-25T09:42:01.258737+0000","last_active":"2023-08-25T09:42:03.143207+0000","last_peered":"2023-08-25T09:42:03.143207+0000","last_clean":"2023-08-25T09:42:03.143207+0000","last_became_active":"2023-08-25T09:42:01.258445+0000","last_became_peered":"2023-08-25T09:42:01.258445+0000","last_unstale":"2023-08-25T09:42:03.143207+0000","last_undegraded":"2023-08-25T09:42:03.143207+0000","last_fullsized":"2023-08-25T09:42:03.143207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142419+0000","last_change":"2023-08-25T09:42:01.268325+0000","last_active":"2023-08-25T09:42:03.142419+0000","last_peered":"2023-08-25T09:42:03.142419+0000","last_clean":"2023-08-25T09:42:03.142419+0000","last_became_active":"2023-08-25T09:42:01.268052+0000","last_became_peered":"2023-08-25T09:42:01.268052+0000","last_unstale":"2023-08-25T09:42:03.142419+0000","last_undegraded":"2023-08-25T09:42:03.142419+0000","last_fullsized":"2023-08-25T09:42:03.142419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142567+0000","last_change":"2023-08-25T09:42:01.265227+0000","last_active":"2023-08-25T09:42:03.142567+0000","last_peered":"2023-08-25T09:42:03.142567+0000","last_clean":"2023-08-25T09:42:03.142567+0000","last_became_active":"2023-08-25T09:42:01.264910+0000","last_became_peered":"2023-08-25T09:42:01.264910+0000","last_unstale":"2023-08-25T09:42:03.142567+0000","last_undegraded":"2023-08-25T09:42:03.142567+0000","last_fullsized":"2023-08-25T09:42:03.142567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142676+0000","last_change":"2023-08-25T09:42:01.260658+0000","last_active":"2023-08-25T09:42:03.142676+0000","last_peered":"2023-08-25T09:42:03.142676+0000","last_clean":"2023-08-25T09:42:03.142676+0000","last_became_active":"2023-08-25T09:42:01.260393+0000","last_became_peered":"2023-08-25T09:42:01.260393+0000","last_unstale":"2023-08-25T09:42:03.142676+0000","last_undegraded":"2023-08-25T09:42:03.142676+0000","last_fullsized":"2023-08-25T09:42:03.142676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142579+0000","last_change":"2023-08-25T09:42:01.262364+0000","last_active":"2023-08-25T09:42:03.142579+0000","last_peered":"2023-08-25T09:42:03.142579+0000","last_clean":"2023-08-25T09:42:03.142579+0000","last_became_active":"2023-08-25T09:42:01.261630+0000","last_became_peered":"2023-08-25T09:42:01.261630+0000","last_unstale":"2023-08-25T09:42:03.142579+0000","last_undegraded":"2023-08-25T09:42:03.142579+0000","last_fullsized":"2023-08-25T09:42:03.142579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:29.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254397+0000","last_change":"2023-08-25T09:42:01.263704+0000","last_active":"2023-08-25T09:42:02.254397+0000","last_peered":"2023-08-25T09:42:02.254397+0000","last_clean":"2023-08-25T09:42:02.254397+0000","last_became_active":"2023-08-25T09:42:01.263194+0000","last_became_peered":"2023-08-25T09:42:01.263194+0000","last_unstale":"2023-08-25T09:42:02.254397+0000","last_undegraded":"2023-08-25T09:42:02.254397+0000","last_fullsized":"2023-08-25T09:42:02.254397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:04.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258087+0000","last_change":"2023-08-25T09:42:01.256034+0000","last_active":"2023-08-25T09:42:02.258087+0000","last_peered":"2023-08-25T09:42:02.258087+0000","last_clean":"2023-08-25T09:42:02.258087+0000","last_became_active":"2023-08-25T09:42:01.255754+0000","last_became_peered":"2023-08-25T09:42:01.255754+0000","last_unstale":"2023-08-25T09:42:02.258087+0000","last_undegraded":"2023-08-25T09:42:02.258087+0000","last_fullsized":"2023-08-25T09:42:02.258087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253974+0000","last_change":"2023-08-25T09:42:01.265526+0000","last_active":"2023-08-25T09:42:02.253974+0000","last_peered":"2023-08-25T09:42:02.253974+0000","last_clean":"2023-08-25T09:42:02.253974+0000","last_became_active":"2023-08-25T09:42:01.265261+0000","last_became_peered":"2023-08-25T09:42:01.265261+0000","last_unstale":"2023-08-25T09:42:02.253974+0000","last_undegraded":"2023-08-25T09:42:02.253974+0000","last_fullsized":"2023-08-25T09:42:02.253974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:31.931382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142922+0000","last_change":"2023-08-25T09:42:01.255047+0000","last_active":"2023-08-25T09:42:03.142922+0000","last_peered":"2023-08-25T09:42:03.142922+0000","last_clean":"2023-08-25T09:42:03.142922+0000","last_became_active":"2023-08-25T09:42:01.254784+0000","last_became_peered":"2023-08-25T09:42:01.254784+0000","last_unstale":"2023-08-25T09:42:03.142922+0000","last_undegraded":"2023-08-25T09:42:03.142922+0000","last_fullsized":"2023-08-25T09:42:03.142922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:46:38.947826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254200+0000","last_change":"2023-08-25T09:42:01.265446+0000","last_active":"2023-08-25T09:42:02.254200+0000","last_peered":"2023-08-25T09:42:02.254200+0000","last_clean":"2023-08-25T09:42:02.254200+0000","last_became_active":"2023-08-25T09:42:01.265198+0000","last_became_peered":"2023-08-25T09:42:01.265198+0000","last_unstale":"2023-08-25T09:42:02.254200+0000","last_undegraded":"2023-08-25T09:42:02.254200+0000","last_fullsized":"2023-08-25T09:42:02.254200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:00.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143462+0000","last_change":"2023-08-25T09:42:00.256713+0000","last_active":"2023-08-25T09:42:03.143462+0000","last_peered":"2023-08-25T09:42:03.143462+0000","last_clean":"2023-08-25T09:42:03.143462+0000","last_became_active":"2023-08-25T09:42:00.256481+0000","last_became_peered":"2023-08-25T09:42:00.256481+0000","last_unstale":"2023-08-25T09:42:03.143462+0000","last_undegraded":"2023-08-25T09:42:03.143462+0000","last_fullsized":"2023-08-25T09:42:03.143462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:49.462578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142835+0000","last_change":"2023-08-25T09:42:01.260370+0000","last_active":"2023-08-25T09:42:03.142835+0000","last_peered":"2023-08-25T09:42:03.142835+0000","last_clean":"2023-08-25T09:42:03.142835+0000","last_became_active":"2023-08-25T09:42:01.260045+0000","last_became_peered":"2023-08-25T09:42:01.260045+0000","last_unstale":"2023-08-25T09:42:03.142835+0000","last_undegraded":"2023-08-25T09:42:03.142835+0000","last_fullsized":"2023-08-25T09:42:03.142835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:29.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728456+0000","last_change":"2023-08-25T09:42:00.251152+0000","last_active":"2023-08-25T09:42:02.728456+0000","last_peered":"2023-08-25T09:42:02.728456+0000","last_clean":"2023-08-25T09:42:02.728456+0000","last_became_active":"2023-08-25T09:42:00.250252+0000","last_became_peered":"2023-08-25T09:42:00.250252+0000","last_unstale":"2023-08-25T09:42:02.728456+0000","last_undegraded":"2023-08-25T09:42:02.728456+0000","last_fullsized":"2023-08-25T09:42:02.728456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:30.927542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728763+0000","last_change":"2023-08-25T09:42:01.262193+0000","last_active":"2023-08-25T09:42:02.728763+0000","last_peered":"2023-08-25T09:42:02.728763+0000","last_clean":"2023-08-25T09:42:02.728763+0000","last_became_active":"2023-08-25T09:42:01.261925+0000","last_became_peered":"2023-08-25T09:42:01.261925+0000","last_unstale":"2023-08-25T09:42:02.728763+0000","last_undegraded":"2023-08-25T09:42:02.728763+0000","last_fullsized":"2023-08-25T09:42:02.728763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143738+0000","last_change":"2023-08-25T09:42:00.255617+0000","last_active":"2023-08-25T09:42:03.143738+0000","last_peered":"2023-08-25T09:42:03.143738+0000","last_clean":"2023-08-25T09:42:03.143738+0000","last_became_active":"2023-08-25T09:42:00.255346+0000","last_became_peered":"2023-08-25T09:42:00.255346+0000","last_unstale":"2023-08-25T09:42:03.143738+0000","last_undegraded":"2023-08-25T09:42:03.143738+0000","last_fullsized":"2023-08-25T09:42:03.143738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:28:09.575735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254340+0000","last_change":"2023-08-25T09:42:01.263525+0000","last_active":"2023-08-25T09:42:02.254340+0000","last_peered":"2023-08-25T09:42:02.254340+0000","last_clean":"2023-08-25T09:42:02.254340+0000","last_became_active":"2023-08-25T09:42:01.263253+0000","last_became_peered":"2023-08-25T09:42:01.263253+0000","last_unstale":"2023-08-25T09:42:02.254340+0000","last_undegraded":"2023-08-25T09:42:02.254340+0000","last_fullsized":"2023-08-25T09:42:02.254340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142980+0000","last_change":"2023-08-25T09:42:00.252199+0000","last_active":"2023-08-25T09:42:03.142980+0000","last_peered":"2023-08-25T09:42:03.142980+0000","last_clean":"2023-08-25T09:42:03.142980+0000","last_became_active":"2023-08-25T09:42:00.251908+0000","last_became_peered":"2023-08-25T09:42:00.251908+0000","last_unstale":"2023-08-25T09:42:03.142980+0000","last_undegraded":"2023-08-25T09:42:03.142980+0000","last_fullsized":"2023-08-25T09:42:03.142980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:18:22.265214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143678+0000","last_change":"2023-08-25T09:42:00.256827+0000","last_active":"2023-08-25T09:42:03.143678+0000","last_peered":"2023-08-25T09:42:03.143678+0000","last_clean":"2023-08-25T09:42:03.143678+0000","last_became_active":"2023-08-25T09:42:00.256436+0000","last_became_peered":"2023-08-25T09:42:00.256436+0000","last_unstale":"2023-08-25T09:42:03.143678+0000","last_undegraded":"2023-08-25T09:42:03.143678+0000","last_fullsized":"2023-08-25T09:42:03.143678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:22:26.505052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142699+0000","last_change":"2023-08-25T09:42:01.260979+0000","last_active":"2023-08-25T09:42:03.142699+0000","last_peered":"2023-08-25T09:42:03.142699+0000","last_clean":"2023-08-25T09:42:03.142699+0000","last_became_active":"2023-08-25T09:42:01.260705+0000","last_became_peered":"2023-08-25T09:42:01.260705+0000","last_unstale":"2023-08-25T09:42:03.142699+0000","last_undegraded":"2023-08-25T09:42:03.142699+0000","last_fullsized":"2023-08-25T09:42:03.142699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143702+0000","last_change":"2023-08-25T09:42:00.256188+0000","last_active":"2023-08-25T09:42:03.143702+0000","last_peered":"2023-08-25T09:42:03.143702+0000","last_clean":"2023-08-25T09:42:03.143702+0000","last_became_active":"2023-08-25T09:42:00.255900+0000","last_became_peered":"2023-08-25T09:42:00.255900+0000","last_unstale":"2023-08-25T09:42:03.143702+0000","last_undegraded":"2023-08-25T09:42:03.143702+0000","last_fullsized":"2023-08-25T09:42:03.143702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:48.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257639+0000","last_change":"2023-08-25T09:42:01.258783+0000","last_active":"2023-08-25T09:42:02.257639+0000","last_peered":"2023-08-25T09:42:02.257639+0000","last_clean":"2023-08-25T09:42:02.257639+0000","last_became_active":"2023-08-25T09:42:01.258514+0000","last_became_peered":"2023-08-25T09:42:01.258514+0000","last_unstale":"2023-08-25T09:42:02.257639+0000","last_undegraded":"2023-08-25T09:42:02.257639+0000","last_fullsized":"2023-08-25T09:42:02.257639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:31.931382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143793+0000","last_change":"2023-08-25T09:42:00.249887+0000","last_active":"2023-08-25T09:42:03.143793+0000","last_peered":"2023-08-25T09:42:03.143793+0000","last_clean":"2023-08-25T09:42:03.143793+0000","last_became_active":"2023-08-25T09:42:00.249627+0000","last_became_peered":"2023-08-25T09:42:00.249627+0000","last_unstale":"2023-08-25T09:42:03.143793+0000","last_undegraded":"2023-08-25T09:42:03.143793+0000","last_fullsized":"2023-08-25T09:42:03.143793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:49.105687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142518+0000","last_change":"2023-08-25T09:42:01.259557+0000","last_active":"2023-08-25T09:42:03.142518+0000","last_peered":"2023-08-25T09:42:03.142518+0000","last_clean":"2023-08-25T09:42:03.142518+0000","last_became_active":"2023-08-25T09:42:01.259321+0000","last_became_peered":"2023-08-25T09:42:01.259321+0000","last_unstale":"2023-08-25T09:42:03.142518+0000","last_undegraded":"2023-08-25T09:42:03.142518+0000","last_fullsized":"2023-08-25T09:42:03.142518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:09.837898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142922+0000","last_change":"2023-08-25T09:42:00.251160+0000","last_active":"2023-08-25T09:42:03.142922+0000","last_peered":"2023-08-25T09:42:03.142922+0000","last_clean":"2023-08-25T09:42:03.142922+0000","last_became_active":"2023-08-25T09:42:00.250732+0000","last_became_peered":"2023-08-25T09:42:00.250732+0000","last_unstale":"2023-08-25T09:42:03.142922+0000","last_undegraded":"2023-08-25T09:42:03.142922+0000","last_fullsized":"2023-08-25T09:42:03.142922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:50.554509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728542+0000","last_change":"2023-08-25T09:42:01.266242+0000","last_active":"2023-08-25T09:42:02.728542+0000","last_peered":"2023-08-25T09:42:02.728542+0000","last_clean":"2023-08-25T09:42:02.728542+0000","last_became_active":"2023-08-25T09:42:01.265828+0000","last_became_peered":"2023-08-25T09:42:01.265828+0000","last_unstale":"2023-08-25T09:42:02.728542+0000","last_undegraded":"2023-08-25T09:42:02.728542+0000","last_fullsized":"2023-08-25T09:42:02.728542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254592+0000","last_change":"2023-08-25T09:42:00.252308+0000","last_active":"2023-08-25T09:42:02.254592+0000","last_peered":"2023-08-25T09:42:02.254592+0000","last_clean":"2023-08-25T09:42:02.254592+0000","last_became_active":"2023-08-25T09:42:00.252073+0000","last_became_peered":"2023-08-25T09:42:00.252073+0000","last_unstale":"2023-08-25T09:42:02.254592+0000","last_undegraded":"2023-08-25T09:42:02.254592+0000","last_fullsized":"2023-08-25T09:42:02.254592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:50.554509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258145+0000","last_change":"2023-08-25T09:42:01.258889+0000","last_active":"2023-08-25T09:42:02.258145+0000","last_peered":"2023-08-25T09:42:02.258145+0000","last_clean":"2023-08-25T09:42:02.258145+0000","last_became_active":"2023-08-25T09:42:01.258615+0000","last_became_peered":"2023-08-25T09:42:01.258615+0000","last_unstale":"2023-08-25T09:42:02.258145+0000","last_undegraded":"2023-08-25T09:42:02.258145+0000","last_fullsized":"2023-08-25T09:42:02.258145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142731+0000","last_change":"2023-08-25T09:42:00.255638+0000","last_active":"2023-08-25T09:42:03.142731+0000","last_peered":"2023-08-25T09:42:03.142731+0000","last_clean":"2023-08-25T09:42:03.142731+0000","last_became_active":"2023-08-25T09:42:00.255344+0000","last_became_peered":"2023-08-25T09:42:00.255344+0000","last_unstale":"2023-08-25T09:42:03.142731+0000","last_undegraded":"2023-08-25T09:42:03.142731+0000","last_fullsized":"2023-08-25T09:42:03.142731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:27.471989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258465+0000","last_change":"2023-08-25T09:42:01.251560+0000","last_active":"2023-08-25T09:42:02.258465+0000","last_peered":"2023-08-25T09:42:02.258465+0000","last_clean":"2023-08-25T09:42:02.258465+0000","last_became_active":"2023-08-25T09:42:01.251268+0000","last_became_peered":"2023-08-25T09:42:01.251268+0000","last_unstale":"2023-08-25T09:42:02.258465+0000","last_undegraded":"2023-08-25T09:42:02.258465+0000","last_fullsized":"2023-08-25T09:42:02.258465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:49.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257907+0000","last_change":"2023-08-25T09:42:00.254661+0000","last_active":"2023-08-25T09:42:02.257907+0000","last_peered":"2023-08-25T09:42:02.257907+0000","last_clean":"2023-08-25T09:42:02.257907+0000","last_became_active":"2023-08-25T09:42:00.253381+0000","last_became_peered":"2023-08-25T09:42:00.253381+0000","last_unstale":"2023-08-25T09:42:02.257907+0000","last_undegraded":"2023-08-25T09:42:02.257907+0000","last_fullsized":"2023-08-25T09:42:02.257907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258437+0000","last_change":"2023-08-25T09:42:01.255458+0000","last_active":"2023-08-25T09:42:02.258437+0000","last_peered":"2023-08-25T09:42:02.258437+0000","last_clean":"2023-08-25T09:42:02.258437+0000","last_became_active":"2023-08-25T09:42:01.255174+0000","last_became_peered":"2023-08-25T09:42:01.255174+0000","last_unstale":"2023-08-25T09:42:02.258437+0000","last_undegraded":"2023-08-25T09:42:02.258437+0000","last_fullsized":"2023-08-25T09:42:02.258437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:31.891505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254199+0000","last_change":"2023-08-25T09:42:00.251897+0000","last_active":"2023-08-25T09:42:02.254199+0000","last_peered":"2023-08-25T09:42:02.254199+0000","last_clean":"2023-08-25T09:42:02.254199+0000","last_became_active":"2023-08-25T09:42:00.251637+0000","last_became_peered":"2023-08-25T09:42:00.251637+0000","last_unstale":"2023-08-25T09:42:02.254199+0000","last_undegraded":"2023-08-25T09:42:02.254199+0000","last_fullsized":"2023-08-25T09:42:02.254199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:05.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142473+0000","last_change":"2023-08-25T09:42:01.262069+0000","last_active":"2023-08-25T09:42:03.142473+0000","last_peered":"2023-08-25T09:42:03.142473+0000","last_clean":"2023-08-25T09:42:03.142473+0000","last_became_active":"2023-08-25T09:42:01.261830+0000","last_became_peered":"2023-08-25T09:42:01.261830+0000","last_unstale":"2023-08-25T09:42:03.142473+0000","last_undegraded":"2023-08-25T09:42:03.142473+0000","last_fullsized":"2023-08-25T09:42:03.142473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143814+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:03.143814+0000","last_peered":"2023-08-25T09:42:03.143814+0000","last_clean":"2023-08-25T09:42:03.143814+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:03.143814+0000","last_undegraded":"2023-08-25T09:42:03.143814+0000","last_fullsized":"2023-08-25T09:42:03.143814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:18:08.583532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142670+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:03.142670+0000","last_peered":"2023-08-25T09:42:03.142670+0000","last_clean":"2023-08-25T09:42:03.142670+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:03.142670+0000","last_undegraded":"2023-08-25T09:42:03.142670+0000","last_fullsized":"2023-08-25T09:42:03.142670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:59.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254092+0000","last_change":"2023-08-25T09:42:00.247378+0000","last_active":"2023-08-25T09:42:02.254092+0000","last_peered":"2023-08-25T09:42:02.254092+0000","last_clean":"2023-08-25T09:42:02.254092+0000","last_became_active":"2023-08-25T09:42:00.247122+0000","last_became_peered":"2023-08-25T09:42:00.247122+0000","last_unstale":"2023-08-25T09:42:02.254092+0000","last_undegraded":"2023-08-25T09:42:02.254092+0000","last_fullsized":"2023-08-25T09:42:02.254092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:28.310394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142498+0000","last_change":"2023-08-25T09:42:01.253735+0000","last_active":"2023-08-25T09:42:03.142498+0000","last_peered":"2023-08-25T09:42:03.142498+0000","last_clean":"2023-08-25T09:42:03.142498+0000","last_became_active":"2023-08-25T09:42:01.253398+0000","last_became_peered":"2023-08-25T09:42:01.253398+0000","last_unstale":"2023-08-25T09:42:03.142498+0000","last_undegraded":"2023-08-25T09:42:03.142498+0000","last_fullsized":"2023-08-25T09:42:03.142498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:17:00.671122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143237+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:03.143237+0000","last_peered":"2023-08-25T09:42:03.143237+0000","last_clean":"2023-08-25T09:42:03.143237+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:03.143237+0000","last_undegraded":"2023-08-25T09:42:03.143237+0000","last_fullsized":"2023-08-25T09:42:03.143237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:24.076968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728342+0000","last_change":"2023-08-25T09:42:00.257069+0000","last_active":"2023-08-25T09:42:02.728342+0000","last_peered":"2023-08-25T09:42:02.728342+0000","last_clean":"2023-08-25T09:42:02.728342+0000","last_became_active":"2023-08-25T09:42:00.256862+0000","last_became_peered":"2023-08-25T09:42:00.256862+0000","last_unstale":"2023-08-25T09:42:02.728342+0000","last_undegraded":"2023-08-25T09:42:02.728342+0000","last_fullsized":"2023-08-25T09:42:02.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:58:16.721689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728703+0000","last_change":"2023-08-25T09:42:01.266329+0000","last_active":"2023-08-25T09:42:02.728703+0000","last_peered":"2023-08-25T09:42:02.728703+0000","last_clean":"2023-08-25T09:42:02.728703+0000","last_became_active":"2023-08-25T09:42:01.266071+0000","last_became_peered":"2023-08-25T09:42:01.266071+0000","last_unstale":"2023-08-25T09:42:02.728703+0000","last_undegraded":"2023-08-25T09:42:02.728703+0000","last_fullsized":"2023-08-25T09:42:02.728703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336077+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:02.336077+0000","last_peered":"2023-08-25T09:42:02.336077+0000","last_clean":"2023-08-25T09:42:02.336077+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:02.336077+0000","last_undegraded":"2023-08-25T09:42:02.336077+0000","last_fullsized":"2023-08-25T09:42:02.336077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:35.544962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142102+0000","last_change":"2023-08-25T09:42:00.247602+0000","last_active":"2023-08-25T09:42:03.142102+0000","last_peered":"2023-08-25T09:42:03.142102+0000","last_clean":"2023-08-25T09:42:03.142102+0000","last_became_active":"2023-08-25T09:42:00.247328+0000","last_became_peered":"2023-08-25T09:42:00.247328+0000","last_unstale":"2023-08-25T09:42:03.142102+0000","last_undegraded":"2023-08-25T09:42:03.142102+0000","last_fullsized":"2023-08-25T09:42:03.142102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:01.555687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142554+0000","last_change":"2023-08-25T09:42:01.263095+0000","last_active":"2023-08-25T09:42:03.142554+0000","last_peered":"2023-08-25T09:42:03.142554+0000","last_clean":"2023-08-25T09:42:03.142554+0000","last_became_active":"2023-08-25T09:42:01.262854+0000","last_became_peered":"2023-08-25T09:42:01.262854+0000","last_unstale":"2023-08-25T09:42:03.142554+0000","last_undegraded":"2023-08-25T09:42:03.142554+0000","last_fullsized":"2023-08-25T09:42:03.142554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:04.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142511+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:03.142511+0000","last_peered":"2023-08-25T09:42:03.142511+0000","last_clean":"2023-08-25T09:42:03.142511+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:03.142511+0000","last_undegraded":"2023-08-25T09:42:03.142511+0000","last_fullsized":"2023-08-25T09:42:03.142511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:38.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258246+0000","last_change":"2023-08-25T09:42:00.256819+0000","last_active":"2023-08-25T09:42:02.258246+0000","last_peered":"2023-08-25T09:42:02.258246+0000","last_clean":"2023-08-25T09:42:02.258246+0000","last_became_active":"2023-08-25T09:42:00.254689+0000","last_became_peered":"2023-08-25T09:42:00.254689+0000","last_unstale":"2023-08-25T09:42:02.258246+0000","last_undegraded":"2023-08-25T09:42:02.258246+0000","last_fullsized":"2023-08-25T09:42:02.258246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142413+0000","last_change":"2023-08-25T09:42:01.268038+0000","last_active":"2023-08-25T09:42:03.142413+0000","last_peered":"2023-08-25T09:42:03.142413+0000","last_clean":"2023-08-25T09:42:03.142413+0000","last_became_active":"2023-08-25T09:42:01.267785+0000","last_became_peered":"2023-08-25T09:42:01.267785+0000","last_unstale":"2023-08-25T09:42:03.142413+0000","last_undegraded":"2023-08-25T09:42:03.142413+0000","last_fullsized":"2023-08-25T09:42:03.142413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143095+0000","last_change":"2023-08-25T09:42:00.246654+0000","last_active":"2023-08-25T09:42:03.143095+0000","last_peered":"2023-08-25T09:42:03.143095+0000","last_clean":"2023-08-25T09:42:03.143095+0000","last_became_active":"2023-08-25T09:42:00.245171+0000","last_became_peered":"2023-08-25T09:42:00.245171+0000","last_unstale":"2023-08-25T09:42:03.143095+0000","last_undegraded":"2023-08-25T09:42:03.143095+0000","last_fullsized":"2023-08-25T09:42:03.143095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:04.608504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142537+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:03.142537+0000","last_peered":"2023-08-25T09:42:03.142537+0000","last_clean":"2023-08-25T09:42:03.142537+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:03.142537+0000","last_undegraded":"2023-08-25T09:42:03.142537+0000","last_fullsized":"2023-08-25T09:42:03.142537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:53.280406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142329+0000","last_change":"2023-08-25T09:42:01.262457+0000","last_active":"2023-08-25T09:42:03.142329+0000","last_peered":"2023-08-25T09:42:03.142329+0000","last_clean":"2023-08-25T09:42:03.142329+0000","last_became_active":"2023-08-25T09:42:01.262194+0000","last_became_peered":"2023-08-25T09:42:01.262194+0000","last_unstale":"2023-08-25T09:42:03.142329+0000","last_undegraded":"2023-08-25T09:42:03.142329+0000","last_fullsized":"2023-08-25T09:42:03.142329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142388+0000","last_change":"2023-08-25T09:42:00.247634+0000","last_active":"2023-08-25T09:42:03.142388+0000","last_peered":"2023-08-25T09:42:03.142388+0000","last_clean":"2023-08-25T09:42:03.142388+0000","last_became_active":"2023-08-25T09:42:00.247346+0000","last_became_peered":"2023-08-25T09:42:00.247346+0000","last_unstale":"2023-08-25T09:42:03.142388+0000","last_undegraded":"2023-08-25T09:42:03.142388+0000","last_fullsized":"2023-08-25T09:42:03.142388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143903+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:03.143903+0000","last_peered":"2023-08-25T09:42:03.143903+0000","last_clean":"2023-08-25T09:42:03.143903+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:03.143903+0000","last_undegraded":"2023-08-25T09:42:03.143903+0000","last_fullsized":"2023-08-25T09:42:03.143903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:03:50.781902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728546+0000","last_change":"2023-08-25T09:42:01.263253+0000","last_active":"2023-08-25T09:42:02.728546+0000","last_peered":"2023-08-25T09:42:02.728546+0000","last_clean":"2023-08-25T09:42:02.728546+0000","last_became_active":"2023-08-25T09:42:01.263001+0000","last_became_peered":"2023-08-25T09:42:01.263001+0000","last_unstale":"2023-08-25T09:42:02.728546+0000","last_undegraded":"2023-08-25T09:42:02.728546+0000","last_fullsized":"2023-08-25T09:42:02.728546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:41.964929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254474+0000","last_change":"2023-08-25T09:42:00.248206+0000","last_active":"2023-08-25T09:42:02.254474+0000","last_peered":"2023-08-25T09:42:02.254474+0000","last_clean":"2023-08-25T09:42:02.254474+0000","last_became_active":"2023-08-25T09:42:00.247625+0000","last_became_peered":"2023-08-25T09:42:00.247625+0000","last_unstale":"2023-08-25T09:42:02.254474+0000","last_undegraded":"2023-08-25T09:42:02.254474+0000","last_fullsized":"2023-08-25T09:42:02.254474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142542+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:03.142542+0000","last_peered":"2023-08-25T09:42:03.142542+0000","last_clean":"2023-08-25T09:42:03.142542+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:03.142542+0000","last_undegraded":"2023-08-25T09:42:03.142542+0000","last_fullsized":"2023-08-25T09:42:03.142542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:46.536888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253996+0000","last_change":"2023-08-25T09:42:01.263406+0000","last_active":"2023-08-25T09:42:02.253996+0000","last_peered":"2023-08-25T09:42:02.253996+0000","last_clean":"2023-08-25T09:42:02.253996+0000","last_became_active":"2023-08-25T09:42:01.263143+0000","last_became_peered":"2023-08-25T09:42:01.263143+0000","last_unstale":"2023-08-25T09:42:02.253996+0000","last_undegraded":"2023-08-25T09:42:02.253996+0000","last_fullsized":"2023-08-25T09:42:02.253996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728789+0000","last_change":"2023-08-25T09:42:00.253767+0000","last_active":"2023-08-25T09:42:02.728789+0000","last_peered":"2023-08-25T09:42:02.728789+0000","last_clean":"2023-08-25T09:42:02.728789+0000","last_became_active":"2023-08-25T09:42:00.253460+0000","last_became_peered":"2023-08-25T09:42:00.253460+0000","last_unstale":"2023-08-25T09:42:02.728789+0000","last_undegraded":"2023-08-25T09:42:02.728789+0000","last_fullsized":"2023-08-25T09:42:02.728789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:57.298027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142868+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:03.142868+0000","last_peered":"2023-08-25T09:42:03.142868+0000","last_clean":"2023-08-25T09:42:03.142868+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:03.142868+0000","last_undegraded":"2023-08-25T09:42:03.142868+0000","last_fullsized":"2023-08-25T09:42:03.142868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:37:45.116830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257770+0000","last_change":"2023-08-25T09:42:01.258092+0000","last_active":"2023-08-25T09:42:02.257770+0000","last_peered":"2023-08-25T09:42:02.257770+0000","last_clean":"2023-08-25T09:42:02.257770+0000","last_became_active":"2023-08-25T09:42:01.257828+0000","last_became_peered":"2023-08-25T09:42:01.257828+0000","last_unstale":"2023-08-25T09:42:02.257770+0000","last_undegraded":"2023-08-25T09:42:02.257770+0000","last_fullsized":"2023-08-25T09:42:02.257770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:41.964929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258184+0000","last_change":"2023-08-25T09:42:01.255733+0000","last_active":"2023-08-25T09:42:02.258184+0000","last_peered":"2023-08-25T09:42:02.258184+0000","last_clean":"2023-08-25T09:42:02.258184+0000","last_became_active":"2023-08-25T09:42:01.255412+0000","last_became_peered":"2023-08-25T09:42:01.255412+0000","last_unstale":"2023-08-25T09:42:02.258184+0000","last_undegraded":"2023-08-25T09:42:02.258184+0000","last_fullsized":"2023-08-25T09:42:02.258184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258437+0000","last_change":"2023-08-25T09:42:00.255320+0000","last_active":"2023-08-25T09:42:02.258437+0000","last_peered":"2023-08-25T09:42:02.258437+0000","last_clean":"2023-08-25T09:42:02.258437+0000","last_became_active":"2023-08-25T09:42:00.254861+0000","last_became_peered":"2023-08-25T09:42:00.254861+0000","last_unstale":"2023-08-25T09:42:02.258437+0000","last_undegraded":"2023-08-25T09:42:02.258437+0000","last_fullsized":"2023-08-25T09:42:02.258437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:04.608504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142304+0000","last_change":"2023-08-25T09:42:01.267806+0000","last_active":"2023-08-25T09:42:03.142304+0000","last_peered":"2023-08-25T09:42:03.142304+0000","last_clean":"2023-08-25T09:42:03.142304+0000","last_became_active":"2023-08-25T09:42:01.267493+0000","last_became_peered":"2023-08-25T09:42:01.267493+0000","last_unstale":"2023-08-25T09:42:03.142304+0000","last_undegraded":"2023-08-25T09:42:03.142304+0000","last_fullsized":"2023-08-25T09:42:03.142304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143653+0000","last_change":"2023-08-25T09:42:00.250835+0000","last_active":"2023-08-25T09:42:03.143653+0000","last_peered":"2023-08-25T09:42:03.143653+0000","last_clean":"2023-08-25T09:42:03.143653+0000","last_became_active":"2023-08-25T09:42:00.250544+0000","last_became_peered":"2023-08-25T09:42:00.250544+0000","last_unstale":"2023-08-25T09:42:03.143653+0000","last_undegraded":"2023-08-25T09:42:03.143653+0000","last_fullsized":"2023-08-25T09:42:03.143653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:30.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143222+0000","last_change":"2023-08-25T09:42:00.245718+0000","last_active":"2023-08-25T09:42:03.143222+0000","last_peered":"2023-08-25T09:42:03.143222+0000","last_clean":"2023-08-25T09:42:03.143222+0000","last_became_active":"2023-08-25T09:42:00.245428+0000","last_became_peered":"2023-08-25T09:42:00.245428+0000","last_unstale":"2023-08-25T09:42:03.143222+0000","last_undegraded":"2023-08-25T09:42:03.143222+0000","last_fullsized":"2023-08-25T09:42:03.143222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:30.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254101+0000","last_change":"2023-08-25T09:42:01.263577+0000","last_active":"2023-08-25T09:42:02.254101+0000","last_peered":"2023-08-25T09:42:02.254101+0000","last_clean":"2023-08-25T09:42:02.254101+0000","last_became_active":"2023-08-25T09:42:01.263306+0000","last_became_peered":"2023-08-25T09:42:01.263306+0000","last_unstale":"2023-08-25T09:42:02.254101+0000","last_undegraded":"2023-08-25T09:42:02.254101+0000","last_fullsized":"2023-08-25T09:42:02.254101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728858+0000","last_change":"2023-08-25T09:42:00.252574+0000","last_active":"2023-08-25T09:42:02.728858+0000","last_peered":"2023-08-25T09:42:02.728858+0000","last_clean":"2023-08-25T09:42:02.728858+0000","last_became_active":"2023-08-25T09:42:00.252212+0000","last_became_peered":"2023-08-25T09:42:00.252212+0000","last_unstale":"2023-08-25T09:42:02.728858+0000","last_undegraded":"2023-08-25T09:42:02.728858+0000","last_fullsized":"2023-08-25T09:42:02.728858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253927+0000","last_change":"2023-08-25T09:42:01.264840+0000","last_active":"2023-08-25T09:42:02.253927+0000","last_peered":"2023-08-25T09:42:02.253927+0000","last_clean":"2023-08-25T09:42:02.253927+0000","last_became_active":"2023-08-25T09:42:01.264587+0000","last_became_peered":"2023-08-25T09:42:01.264587+0000","last_unstale":"2023-08-25T09:42:02.253927+0000","last_undegraded":"2023-08-25T09:42:02.253927+0000","last_fullsized":"2023-08-25T09:42:02.253927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:58:17.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142685+0000","last_change":"2023-08-25T09:42:01.254378+0000","last_active":"2023-08-25T09:42:03.142685+0000","last_peered":"2023-08-25T09:42:03.142685+0000","last_clean":"2023-08-25T09:42:03.142685+0000","last_became_active":"2023-08-25T09:42:01.254119+0000","last_became_peered":"2023-08-25T09:42:01.254119+0000","last_unstale":"2023-08-25T09:42:03.142685+0000","last_undegraded":"2023-08-25T09:42:03.142685+0000","last_fullsized":"2023-08-25T09:42:03.142685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:59:38.136685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254075+0000","last_change":"2023-08-25T09:42:00.251114+0000","last_active":"2023-08-25T09:42:02.254075+0000","last_peered":"2023-08-25T09:42:02.254075+0000","last_clean":"2023-08-25T09:42:02.254075+0000","last_became_active":"2023-08-25T09:42:00.250565+0000","last_became_peered":"2023-08-25T09:42:00.250565+0000","last_unstale":"2023-08-25T09:42:02.254075+0000","last_undegraded":"2023-08-25T09:42:02.254075+0000","last_fullsized":"2023-08-25T09:42:02.254075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:40.961089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728653+0000","last_change":"2023-08-25T09:42:01.261782+0000","last_active":"2023-08-25T09:42:02.728653+0000","last_peered":"2023-08-25T09:42:02.728653+0000","last_clean":"2023-08-25T09:42:02.728653+0000","last_became_active":"2023-08-25T09:42:01.261499+0000","last_became_peered":"2023-08-25T09:42:01.261499+0000","last_unstale":"2023-08-25T09:42:02.728653+0000","last_undegraded":"2023-08-25T09:42:02.728653+0000","last_fullsized":"2023-08-25T09:42:02.728653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142273+0000","last_change":"2023-08-25T09:42:00.246237+0000","last_active":"2023-08-25T09:42:03.142273+0000","last_peered":"2023-08-25T09:42:03.142273+0000","last_clean":"2023-08-25T09:42:03.142273+0000","last_became_active":"2023-08-25T09:42:00.245983+0000","last_became_peered":"2023-08-25T09:42:00.245983+0000","last_unstale":"2023-08-25T09:42:03.142273+0000","last_undegraded":"2023-08-25T09:42:03.142273+0000","last_fullsized":"2023-08-25T09:42:03.142273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:40.961089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254335+0000","last_change":"2023-08-25T09:42:01.264960+0000","last_active":"2023-08-25T09:42:02.254335+0000","last_peered":"2023-08-25T09:42:02.254335+0000","last_clean":"2023-08-25T09:42:02.254335+0000","last_became_active":"2023-08-25T09:42:01.264576+0000","last_became_peered":"2023-08-25T09:42:01.264576+0000","last_unstale":"2023-08-25T09:42:02.254335+0000","last_undegraded":"2023-08-25T09:42:02.254335+0000","last_fullsized":"2023-08-25T09:42:02.254335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258178+0000","last_change":"2023-08-25T09:42:00.257481+0000","last_active":"2023-08-25T09:42:02.258178+0000","last_peered":"2023-08-25T09:42:02.258178+0000","last_clean":"2023-08-25T09:42:02.258178+0000","last_became_active":"2023-08-25T09:42:00.256520+0000","last_became_peered":"2023-08-25T09:42:00.256520+0000","last_unstale":"2023-08-25T09:42:02.258178+0000","last_undegraded":"2023-08-25T09:42:02.258178+0000","last_fullsized":"2023-08-25T09:42:02.258178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:03.531753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336267+0000","last_change":"2023-08-25T09:42:01.260221+0000","last_active":"2023-08-25T09:42:02.336267+0000","last_peered":"2023-08-25T09:42:02.336267+0000","last_clean":"2023-08-25T09:42:02.336267+0000","last_became_active":"2023-08-25T09:42:01.259978+0000","last_became_peered":"2023-08-25T09:42:01.259978+0000","last_unstale":"2023-08-25T09:42:02.336267+0000","last_undegraded":"2023-08-25T09:42:02.336267+0000","last_fullsized":"2023-08-25T09:42:02.336267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:47.820393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728686+0000","last_change":"2023-08-25T09:42:00.254955+0000","last_active":"2023-08-25T09:42:02.728686+0000","last_peered":"2023-08-25T09:42:02.728686+0000","last_clean":"2023-08-25T09:42:02.728686+0000","last_became_active":"2023-08-25T09:42:00.254662+0000","last_became_peered":"2023-08-25T09:42:00.254662+0000","last_unstale":"2023-08-25T09:42:02.728686+0000","last_undegraded":"2023-08-25T09:42:02.728686+0000","last_fullsized":"2023-08-25T09:42:02.728686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:42.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257933+0000","last_change":"2023-08-25T09:42:01.267712+0000","last_active":"2023-08-25T09:42:02.257933+0000","last_peered":"2023-08-25T09:42:02.257933+0000","last_clean":"2023-08-25T09:42:02.257933+0000","last_became_active":"2023-08-25T09:42:01.267500+0000","last_became_peered":"2023-08-25T09:42:01.267500+0000","last_unstale":"2023-08-25T09:42:02.257933+0000","last_undegraded":"2023-08-25T09:42:02.257933+0000","last_fullsized":"2023-08-25T09:42:02.257933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142588+0000","last_change":"2023-08-25T09:42:00.256003+0000","last_active":"2023-08-25T09:42:03.142588+0000","last_peered":"2023-08-25T09:42:03.142588+0000","last_clean":"2023-08-25T09:42:03.142588+0000","last_became_active":"2023-08-25T09:42:00.255738+0000","last_became_peered":"2023-08-25T09:42:00.255738+0000","last_unstale":"2023-08-25T09:42:03.142588+0000","last_undegraded":"2023-08-25T09:42:03.142588+0000","last_fullsized":"2023-08-25T09:42:03.142588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257821+0000","last_change":"2023-08-25T09:42:01.262161+0000","last_active":"2023-08-25T09:42:02.257821+0000","last_peered":"2023-08-25T09:42:02.257821+0000","last_clean":"2023-08-25T09:42:02.257821+0000","last_became_active":"2023-08-25T09:42:01.261909+0000","last_became_peered":"2023-08-25T09:42:01.261909+0000","last_unstale":"2023-08-25T09:42:02.257821+0000","last_undegraded":"2023-08-25T09:42:02.257821+0000","last_fullsized":"2023-08-25T09:42:02.257821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142973+0000","last_change":"2023-08-25T09:42:00.254336+0000","last_active":"2023-08-25T09:42:03.142973+0000","last_peered":"2023-08-25T09:42:03.142973+0000","last_clean":"2023-08-25T09:42:03.142973+0000","last_became_active":"2023-08-25T09:42:00.253946+0000","last_became_peered":"2023-08-25T09:42:00.253946+0000","last_unstale":"2023-08-25T09:42:03.142973+0000","last_undegraded":"2023-08-25T09:42:03.142973+0000","last_fullsized":"2023-08-25T09:42:03.142973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:49.462578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254470+0000","last_change":"2023-08-25T09:42:01.260614+0000","last_active":"2023-08-25T09:42:02.254470+0000","last_peered":"2023-08-25T09:42:02.254470+0000","last_clean":"2023-08-25T09:42:02.254470+0000","last_became_active":"2023-08-25T09:42:01.260326+0000","last_became_peered":"2023-08-25T09:42:01.260326+0000","last_unstale":"2023-08-25T09:42:02.254470+0000","last_undegraded":"2023-08-25T09:42:02.254470+0000","last_fullsized":"2023-08-25T09:42:02.254470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254260+0000","last_change":"2023-08-25T09:42:00.249214+0000","last_active":"2023-08-25T09:42:02.254260+0000","last_peered":"2023-08-25T09:42:02.254260+0000","last_clean":"2023-08-25T09:42:02.254260+0000","last_became_active":"2023-08-25T09:42:00.248966+0000","last_became_peered":"2023-08-25T09:42:00.248966+0000","last_unstale":"2023-08-25T09:42:02.254260+0000","last_undegraded":"2023-08-25T09:42:02.254260+0000","last_fullsized":"2023-08-25T09:42:02.254260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:38.030002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257726+0000","last_change":"2023-08-25T09:42:01.255482+0000","last_active":"2023-08-25T09:42:02.257726+0000","last_peered":"2023-08-25T09:42:02.257726+0000","last_clean":"2023-08-25T09:42:02.257726+0000","last_became_active":"2023-08-25T09:42:01.254896+0000","last_became_peered":"2023-08-25T09:42:01.254896+0000","last_unstale":"2023-08-25T09:42:02.257726+0000","last_undegraded":"2023-08-25T09:42:02.257726+0000","last_fullsized":"2023-08-25T09:42:02.257726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728778+0000","last_change":"2023-08-25T09:42:00.252428+0000","last_active":"2023-08-25T09:42:02.728778+0000","last_peered":"2023-08-25T09:42:02.728778+0000","last_clean":"2023-08-25T09:42:02.728778+0000","last_became_active":"2023-08-25T09:42:00.251889+0000","last_became_peered":"2023-08-25T09:42:00.251889+0000","last_unstale":"2023-08-25T09:42:02.728778+0000","last_undegraded":"2023-08-25T09:42:02.728778+0000","last_fullsized":"2023-08-25T09:42:02.728778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:03.531753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":675142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":83598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":91267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T09:42:04.552 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-25T09:42:04.552 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-25T09:42:04.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-25T09:42:04.554 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-25T09:42:04.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd676dc8640 1 Processor -- start 2023-08-25T09:42:04.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd676dc8640 1 -- start start 2023-08-25T09:42:04.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd676dc8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6700b7c10 0x7fd670070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd676dc8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700b3040 con 0x7fd670070fd0 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd676dc8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700b27a0 con 0x7fd67006fb00 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd676dc8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700b2a80 con 0x7fd6700b7c10 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd674b64640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6700b7c10 0x7fd670070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd674b64640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6700b7c10 0x7fd670070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33776/0 (socket says 172.21.15.89:33776) 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd66ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd670070fd0 0x7fd670141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33252/0 (socket says 172.21.15.89:33252) 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.680+0000 7fd674b64640 1 -- 172.21.15.89:0/2167688648 learned_addr learned my addr 172.21.15.89:0/2167688648 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.681+0000 7fd674b64640 1 -- 172.21.15.89:0/2167688648 >> v1:172.21.15.121:6789/0 conn(0x7fd67006fb00 legacy=0x7fd670151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:04.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.681+0000 7fd674b64640 1 -- 172.21.15.89:0/2167688648 >> v1:172.21.15.89:6789/0 conn(0x7fd670070fd0 legacy=0x7fd670141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.681+0000 7fd66f7fe640 1 -- 172.21.15.89:0/2167688648 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355949708 0 0) 0x7fd6700b3040 con 0x7fd670070fd0 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.681+0000 7fd674b64640 1 -- 172.21.15.89:0/2167688648 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700b2d60 con 0x7fd6700b7c10 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.681+0000 7fd674b64640 1 --2- 172.21.15.89:0/2167688648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6700b7c10 0x7fd670070a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd66400bb10 tx=0x7fd66402e280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c18bc8de7a3db94 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd66f7fe640 1 -- 172.21.15.89:0/2167688648 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664036640 con 0x7fd6700b7c10 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd66f7fe640 1 -- 172.21.15.89:0/2167688648 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6640367a0 con 0x7fd6700b7c10 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd66f7fe640 1 -- 172.21.15.89:0/2167688648 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664036b30 con 0x7fd6700b7c10 2023-08-25T09:42:04.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 -- 172.21.15.89:0/2167688648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6700b7c10 msgr2=0x7fd670070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 --2- 172.21.15.89:0/2167688648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6700b7c10 0x7fd670070a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd66400bb10 tx=0x7fd66402e280 comp rx=0 tx=0).stop 2023-08-25T09:42:04.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 -- 172.21.15.89:0/2167688648 shutdown_connections 2023-08-25T09:42:04.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 --2- 172.21.15.89:0/2167688648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6700b7c10 0x7fd670070a90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 -- 172.21.15.89:0/2167688648 >> 172.21.15.89:0/2167688648 conn(0x7fd670069a30 msgr2=0x7fd670069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 -- 172.21.15.89:0/2167688648 shutdown_connections 2023-08-25T09:42:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.682+0000 7fd676dc8640 1 -- 172.21.15.89:0/2167688648 wait complete. 2023-08-25T09:42:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.683+0000 7fd676dc8640 1 Processor -- start 2023-08-25T09:42:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.683+0000 7fd676dc8640 1 -- start start 2023-08-25T09:42:04.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd676dc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd67006fb00 0x7fd67013acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd676dc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 0x7fd6700b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd676dc8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6700b7c10 0x7fd6700bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd676dc8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700b57c0 con 0x7fd670070fd0 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd676dc8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670143480 con 0x7fd67006fb00 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd676dc8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701426e0 con 0x7fd6700b7c10 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 0x7fd6700b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 0x7fd6700b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33788/0 (socket says 172.21.15.89:33788) 2023-08-25T09:42:04.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 -- 172.21.15.89:0/1529183291 learned_addr learned my addr 172.21.15.89:0/1529183291 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd674b64640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd67006fb00 0x7fd67013acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd675365640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6700b7c10 0x7fd6700bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 -- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6700b7c10 msgr2=0x7fd6700bc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6700b7c10 0x7fd6700bc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 -- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd67006fb00 msgr2=0x7fd67013acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd67006fb00 0x7fd67013acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.684+0000 7fd66ffff640 1 -- 172.21.15.89:0/1529183291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66400b770 con 0x7fd670070fd0 2023-08-25T09:42:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.685+0000 7fd66ffff640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 0x7fd6700b5be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00c4d0 tx=0x7fd65c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.685+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0074e0 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.685+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c007660 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.685+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6701429c0 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.685+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c004a20 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.685+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67013ba10 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.686+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd670073bf0 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.686+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd65c004b80 con 0x7fd670070fd0 2023-08-25T09:42:04.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.686+0000 7fd66d7fa640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd65406a050 0x7fd65406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.687+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd65c087a00 con 0x7fd670070fd0 2023-08-25T09:42:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.687+0000 7fd674b64640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd65406a050 0x7fd65406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:04.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.687+0000 7fd674b64640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd65406a050 0x7fd65406c510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd664038000 tx=0x7fd664032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:04.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.691+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd65c0531a0 con 0x7fd670070fd0 2023-08-25T09:42:04.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.902+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd670070540 con 0x7fd670070fd0 2023-08-25T09:42:04.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.904+0000 7fd66d7fa640 1 -- 172.21.15.89:0/1529183291 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169489 (secure 0 0 0) 0x7fd65c018090 con 0x7fd670070fd0 2023-08-25T09:42:04.909 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:04.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd65406a050 msgr2=0x7fd65406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd65406a050 0x7fd65406c510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd664038000 tx=0x7fd664032000 comp rx=0 tx=0).stop 2023-08-25T09:42:04.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 msgr2=0x7fd6700b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:04.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 0x7fd6700b5be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00c4d0 tx=0x7fd65c00c990 comp rx=0 tx=0).stop 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 shutdown_connections 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd65406a050 0x7fd65406c510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd670070fd0 0x7fd6700b5be0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6700b7c10 0x7fd6700bc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 --2- 172.21.15.89:0/1529183291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd67006fb00 0x7fd67013acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 >> 172.21.15.89:0/1529183291 conn(0x7fd670069a30 msgr2=0x7fd6700b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:04.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 shutdown_connections 2023-08-25T09:42:04.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:04.907+0000 7fd676dc8640 1 -- 172.21.15.89:0/1529183291 wait complete. 2023-08-25T09:42:04.920 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":660095854},{"type":"v1","addr":"172.21.15.89:6833","nonce":660095854}]},"active_addr":"172.21.15.89:6833/660095854","active_change":"2023-08-25T09:41:40.492696+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3322815548}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1401163404}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3766821257}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3703122977}]}]} 2023-08-25T09:42:04.925 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-25T09:42:04.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-25T09:42:04.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:05.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.021+0000 7f1a2f10c640 1 Processor -- start 2023-08-25T09:42:05.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.021+0000 7f1a2f10c640 1 -- start start 2023-08-25T09:42:05.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2f10c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a28070120 0x7f1a28070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2f10c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a2806f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2f10c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a28070a40 con 0x7f1a28146f60 2023-08-25T09:42:05.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2f10c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2806ec00 con 0x7f1a28070120 2023-08-25T09:42:05.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2f10c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2806f560 con 0x7f1a280b2e20 2023-08-25T09:42:05.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2cea8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a28070120 0x7f1a28070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.022+0000 7f1a2d6a9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a2806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a27fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1a28146f60 0x7f1a281441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:42146/0 (socket says 172.21.15.89:42146) 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a27fff640 1 -- 172.21.15.89:0/2936370835 learned_addr learned my addr 172.21.15.89:0/2936370835 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/2936370835 >> v2:172.21.15.121:3300/0 conn(0x7f1a28070120 msgr2=0x7f1a28070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a2d6a9640 1 --2- 172.21.15.89:0/2936370835 >> v2:172.21.15.121:3300/0 conn(0x7f1a28070120 0x7f1a28070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/2936370835 >> v1:172.21.15.121:6789/0 conn(0x7f1a28146f60 legacy=0x7f1a281441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/2936370835 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280b3530 con 0x7f1a280b2e20 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a277fe640 1 -- 172.21.15.89:0/2936370835 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077138150 0 0) 0x7f1a14001110 con 0x7f1a28146f60 2023-08-25T09:42:05.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.023+0000 7f1a2cea8640 1 --2- 172.21.15.89:0/2936370835 >> v2:172.21.15.121:3300/0 conn(0x7f1a28070120 0x7f1a28070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:05.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2d6a9640 1 --2- 172.21.15.89:0/2936370835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a2806f020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000aea0 tx=0x7f1a2002cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967f5f2c2e87ae48 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a277fe640 1 -- 172.21.15.89:0/2936370835 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2002dab0 con 0x7f1a280b2e20 2023-08-25T09:42:05.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a277fe640 1 -- 172.21.15.89:0/2936370835 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2002dc10 con 0x7f1a280b2e20 2023-08-25T09:42:05.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a277fe640 1 -- 172.21.15.89:0/2936370835 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000a2e0 con 0x7f1a280b2e20 2023-08-25T09:42:05.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 -- 172.21.15.89:0/2936370835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 msgr2=0x7f1a2806f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/2936370835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a2806f020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000aea0 tx=0x7f1a2002cf10 comp rx=0 tx=0).stop 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 -- 172.21.15.89:0/2936370835 shutdown_connections 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/2936370835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a2806f020 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/2936370835 >> v2:172.21.15.121:3300/0 conn(0x7f1a28070120 0x7f1a28070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 -- 172.21.15.89:0/2936370835 >> 172.21.15.89:0/2936370835 conn(0x7f1a28069a30 msgr2=0x7f1a28069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 -- 172.21.15.89:0/2936370835 shutdown_connections 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.024+0000 7f1a2f10c640 1 -- 172.21.15.89:0/2936370835 wait complete. 2023-08-25T09:42:05.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.025+0000 7f1a2f10c640 1 Processor -- start 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.025+0000 7f1a2f10c640 1 -- start start 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2f10c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a28070120 0x7f1a28140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2f10c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a280bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2f10c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 0x7f1a281dee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2f10c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281410a0 con 0x7f1a28146f60 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2f10c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280bab50 con 0x7f1a28070120 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2f10c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28141270 con 0x7f1a280b2e20 2023-08-25T09:42:05.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2d6a9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 0x7f1a281dee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2d6a9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 0x7f1a281dee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33796/0 (socket says 172.21.15.89:33796) 2023-08-25T09:42:05.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.026+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/710047909 learned_addr learned my addr 172.21.15.89:0/710047909 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a27fff640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a280bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2cea8640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a28070120 0x7f1a28140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 msgr2=0x7f1a280bb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2d6a9640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a280bb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a28070120 msgr2=0x7f1a28140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2d6a9640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a28070120 0x7f1a28140b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2d6a9640 1 -- 172.21.15.89:0/710047909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009400 con 0x7f1a28146f60 2023-08-25T09:42:05.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2cea8640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a28070120 0x7f1a28140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:05.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a27fff640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a280bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:05.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2d6a9640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 0x7f1a281dee30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000aea0 tx=0x7f1a20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000a2e0 con 0x7f1a28146f60 2023-08-25T09:42:05.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000a560 con 0x7f1a28146f60 2023-08-25T09:42:05.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2000ab80 con 0x7f1a28146f60 2023-08-25T09:42:05.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20040690 con 0x7f1a28146f60 2023-08-25T09:42:05.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.027+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a280ba070 con 0x7f1a28146f60 2023-08-25T09:42:05.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.028+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a28073bf0 con 0x7f1a28146f60 2023-08-25T09:42:05.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.028+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a200407f0 con 0x7f1a28146f60 2023-08-25T09:42:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.029+0000 7f1a257fa640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1a0c06a050 0x7f1a0c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.029+0000 7f1a2cea8640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1a0c06a050 0x7f1a0c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.029+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a200ab550 con 0x7f1a28146f60 2023-08-25T09:42:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.029+0000 7f1a2cea8640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1a0c06a050 0x7f1a0c06c510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009bb0 tx=0x7f1a1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.033+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1a20076bb0 con 0x7f1a28146f60 2023-08-25T09:42:05.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.199+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a280b9870 con 0x7f1a28146f60 2023-08-25T09:42:05.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.200+0000 7f1a257fa640 1 -- 172.21.15.89:0/710047909 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f1a2007a1d0 con 0x7f1a28146f60 2023-08-25T09:42:05.203 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:05.204 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:05.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1a0c06a050 msgr2=0x7f1a0c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1a0c06a050 0x7f1a0c06c510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009bb0 tx=0x7f1a1c008040 comp rx=0 tx=0).stop 2023-08-25T09:42:05.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 msgr2=0x7f1a281dee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 0x7f1a281dee30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000aea0 tx=0x7f1a20004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 shutdown_connections 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1a0c06a050 0x7f1a0c06c510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a28146f60 0x7f1a281dee30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a280b2e20 0x7f1a280bb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 --2- 172.21.15.89:0/710047909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a28070120 0x7f1a28140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 >> 172.21.15.89:0/710047909 conn(0x7f1a28069a30 msgr2=0x7f1a2813b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 shutdown_connections 2023-08-25T09:42:05.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.202+0000 7f1a2f10c640 1 -- 172.21.15.89:0/710047909 wait complete. 2023-08-25T09:42:05.215 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-25T09:42:05.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:05.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f3d95d640 1 Processor -- start 2023-08-25T09:42:05.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f3d95d640 1 -- start start 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f3d95d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f381560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f3d95d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f38145020 con 0x7f0f380b6ec0 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f3d95d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f380b9330 con 0x7f0f38144c40 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f3d95d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b7d70 con 0x7f0f380bcc70 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f367fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0f380b6ec0 0x7f0f3814ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:33256/0 (socket says 172.21.15.89:33256) 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f367fc640 1 -- 172.21.15.89:0/3667802447 learned_addr learned my addr 172.21.15.89:0/3667802447 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:05.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.314+0000 7f0f377fe640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f381560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279321830 0 0) 0x7f0f38145020 con 0x7f0f380b6ec0 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f20003520 con 0x7f0f380b6ec0 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075507590 0 0) 0x7f0f380b9330 con 0x7f0f38144c40 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f38145020 con 0x7f0f38144c40 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3880813740 0 0) 0x7f0f20003520 con 0x7f0f380b6ec0 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 msgr2=0x7f0f381560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f381560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 >> v1:172.21.15.121:6789/0 conn(0x7f0f38144c40 legacy=0x7f0f380b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380bd290 con 0x7f0f380b6ec0 2023-08-25T09:42:05.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f0f28001670 con 0x7f0f380b6ec0 2023-08-25T09:42:05.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f377fe640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f381560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:05.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 >> v1:172.21.15.89:6789/0 conn(0x7f0f380b6ec0 legacy=0x7f0f3814ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f20003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f20004d00 0x7f0f20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b7d70 con 0x7f0f20003ba0 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2000ba30 con 0x7f0f20004d00 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2000bbf0 con 0x7f0f380bcc70 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f20003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f377fe640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f20004d00 0x7f0f20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f367fc640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f36ffd640 1 -- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 msgr2=0x7f0f200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f36ffd640 1 -- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f20004d00 msgr2=0x7f0f20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f20004d00 0x7f0f20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f36ffd640 1 -- 172.21.15.89:0/3667802447 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f30009a70 con 0x7f0f20003ba0 2023-08-25T09:42:05.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f367fc640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f380bcc70 0x7f0f200047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:05.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.315+0000 7f0f377fe640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f20004d00 0x7f0f20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:05.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.316+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f20003fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0018a0 tx=0x7f0f200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc32444e9f7efa12 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.316+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0052d0 con 0x7f0f20003ba0 2023-08-25T09:42:05.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.316+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c005430 con 0x7f0f20003ba0 2023-08-25T09:42:05.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.316+0000 7f0f35ffb640 1 -- 172.21.15.89:0/3667802447 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c003810 con 0x7f0f20003ba0 2023-08-25T09:42:05.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f3d95d640 1 -- 172.21.15.89:0/3667802447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 msgr2=0x7f0f20003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/3667802447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f20003fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0018a0 tx=0x7f0f200057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f377fe640 1 -- 172.21.15.89:0/3667802447 reap_dead start 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f3d95d640 1 -- 172.21.15.89:0/3667802447 shutdown_connections 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f3d95d640 1 -- 172.21.15.89:0/3667802447 >> 172.21.15.89:0/3667802447 conn(0x7f0f380654f0 msgr2=0x7f0f380658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f3d95d640 1 -- 172.21.15.89:0/3667802447 shutdown_connections 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.317+0000 7f0f3d95d640 1 -- 172.21.15.89:0/3667802447 wait complete. 2023-08-25T09:42:05.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 Processor -- start 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 -- start start 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f38147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f381467f0 0x7f0f38146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f380b1ea0 0x7f0f380b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f381459f0 con 0x7f0f20003ba0 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b2890 con 0x7f0f380b1ea0 2023-08-25T09:42:05.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f3d95d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38146250 con 0x7f0f381467f0 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f38147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.318+0000 7f0f36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f38147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33820/0 (socket says 172.21.15.89:33820) 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 -- 172.21.15.89:0/862231307 learned_addr learned my addr 172.21.15.89:0/862231307 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f377fe640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f380b1ea0 0x7f0f380b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f367fc640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f381467f0 0x7f0f38146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 -- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f381467f0 msgr2=0x7f0f38146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f381467f0 0x7f0f38146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 -- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f380b1ea0 msgr2=0x7f0f380b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f380b1ea0 0x7f0f380b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 -- 172.21.15.89:0/862231307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f38145c00 con 0x7f0f20003ba0 2023-08-25T09:42:05.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f377fe640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f380b1ea0 0x7f0f380b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:05.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f367fc640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f381467f0 0x7f0f38146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:05.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f36ffd640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f38147a20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c035040 tx=0x7f0f2c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c007240 con 0x7f0f20003ba0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c0073a0 con 0x7f0f20003ba0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.319+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c006e10 con 0x7f0f20003ba0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.320+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f38145ee0 con 0x7f0f20003ba0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.320+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f38147f60 con 0x7f0f20003ba0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.320+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f38073bf0 con 0x7f0f20003ba0 2023-08-25T09:42:05.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.321+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f2c0035f0 con 0x7f0f20003ba0 2023-08-25T09:42:05.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.321+0000 7f0f1ffff640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0f2406a080 0x7f0f2406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.321+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f2c0a9dd0 con 0x7f0f20003ba0 2023-08-25T09:42:05.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.321+0000 7f0f367fc640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0f2406a080 0x7f0f2406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.322+0000 7f0f367fc640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0f2406a080 0x7f0f2406c540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f28000f60 tx=0x7f0f28000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.325+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0f2c075600 con 0x7f0f20003ba0 2023-08-25T09:42:05.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.492+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f380bc3d0 con 0x7f0f20003ba0 2023-08-25T09:42:05.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.493+0000 7f0f1ffff640 1 -- 172.21.15.89:0/862231307 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f0f2c078c20 con 0x7f0f20003ba0 2023-08-25T09:42:05.496 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:05.497 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0f2406a080 msgr2=0x7f0f2406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0f2406a080 0x7f0f2406c540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f28000f60 tx=0x7f0f28000ed0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 msgr2=0x7f0f38147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f38147a20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c035040 tx=0x7f0f2c0012d0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 shutdown_connections 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0f2406a080 0x7f0f2406c540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f380b1ea0 0x7f0f380b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f381467f0 0x7f0f38146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 --2- 172.21.15.89:0/862231307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f20003ba0 0x7f0f38147a20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 >> 172.21.15.89:0/862231307 conn(0x7f0f380654f0 msgr2=0x7f0f380be110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 shutdown_connections 2023-08-25T09:42:05.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.495+0000 7f0f3d95d640 1 -- 172.21.15.89:0/862231307 wait complete. 2023-08-25T09:42:05.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-25T09:42:05.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-25T09:42:05.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-25T09:42:05.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-25T09:42:05.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-25T09:42:05.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-25T09:42:05.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-25T09:42:05.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-25T09:42:05.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.679+0000 7fdaca760640 1 Processor -- start 2023-08-25T09:42:05.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.679+0000 7efd5f6d3640 1 Processor -- start 2023-08-25T09:42:05.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fbb19dc2640 1 Processor -- start 2023-08-25T09:42:05.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fd61f087640 1 Processor -- start 2023-08-25T09:42:05.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fd61f087640 1 -- start start 2023-08-25T09:42:05.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fbb19dc2640 1 -- start start 2023-08-25T09:42:05.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7efd5f6d3640 1 -- start start 2023-08-25T09:42:05.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7f592cf08640 1 Processor -- start 2023-08-25T09:42:05.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7f592cf08640 1 -- start start 2023-08-25T09:42:05.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fd61f087640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 0x7fd6180711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fd61f087640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61806e970 con 0x7fd6180b7920 2023-08-25T09:42:05.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fd61f087640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61806e640 con 0x7fd618069ac0 2023-08-25T09:42:05.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fd61f087640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd618070d80 con 0x7fd6180708a0 2023-08-25T09:42:05.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7f1cf9883640 1 Processor -- start 2023-08-25T09:42:05.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7f1cf9883640 1 -- start start 2023-08-25T09:42:05.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f4a83186640 1 Processor -- start 2023-08-25T09:42:05.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fd617fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 0x7fd6180711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fd617fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 0x7fd6180711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:42614/0 (socket says 172.21.15.89:42614) 2023-08-25T09:42:05.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fd617fff640 1 -- 172.21.15.89:0/4126926983 learned_addr learned my addr 172.21.15.89:0/4126926983 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf9883640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1cf4071290 0x7f1cf414f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf9883640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1cf4071ba0 0x7f1cf4069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf9883640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf414f2d0 con 0x7f1cf40701b0 2023-08-25T09:42:05.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf9883640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf406a620 con 0x7f1cf4071290 2023-08-25T09:42:05.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf9883640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf4070660 con 0x7f1cf4071ba0 2023-08-25T09:42:05.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb19dc2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb1406e640 0x7fbb1414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb19dc2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1406f380 con 0x7fbb14069ac0 2023-08-25T09:42:05.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb19dc2640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1406f050 con 0x7fbb140b78e0 2023-08-25T09:42:05.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb19dc2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140b7e30 con 0x7fbb1406e640 2023-08-25T09:42:05.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf27fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1cf4071ba0 0x7f1cf4069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf27fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1cf4071ba0 0x7f1cf4069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:50790/0 (socket says 172.21.15.89:50790) 2023-08-25T09:42:05.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf27fc640 1 -- 172.21.15.89:0/3606014981 learned_addr learned my addr 172.21.15.89:0/3606014981 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f4a83186640 1 -- start start 2023-08-25T09:42:05.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb13fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb1406e640 0x7fbb1414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb13fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb1406e640 0x7fbb1414dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:50798/0 (socket says 172.21.15.89:50798) 2023-08-25T09:42:05.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fbb13fff640 1 -- 172.21.15.89:0/830762257 learned_addr learned my addr 172.21.15.89:0/830762257 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5f6d3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58070ba0 0x7efd580b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5f6d3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd58142880 0x7efd5814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5f6d3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd58070730 con 0x7efd580b37d0 2023-08-25T09:42:05.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5f6d3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580b59c0 con 0x7efd58142880 2023-08-25T09:42:05.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5f6d3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5814b960 con 0x7efd58070ba0 2023-08-25T09:42:05.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f592cf08640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f59280b32f0 0x7f59280b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5cc6e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efd580b37d0 0x7efd58142170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:42184/0 (socket says 172.21.15.89:42184) 2023-08-25T09:42:05.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5cc6e640 1 -- 172.21.15.89:0/4042389155 learned_addr learned my addr 172.21.15.89:0/4042389155 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:05.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7efd5d46f640 1 --2- 172.21.15.89:0/4042389155 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58070ba0 0x7efd580b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f1cf2ffd640 1 --2- 172.21.15.89:0/3606014981 >> v2:172.21.15.89:3300/0 conn(0x7f1cf4071290 0x7f1cf414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f1cf27fc640 1 -- 172.21.15.89:0/3606014981 >> v2:172.21.15.89:3300/0 conn(0x7f1cf4071290 msgr2=0x7f1cf414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f1cf27fc640 1 --2- 172.21.15.89:0/3606014981 >> v2:172.21.15.89:3300/0 conn(0x7f1cf4071290 0x7f1cf414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f1cf27fc640 1 -- 172.21.15.89:0/3606014981 >> v1:172.21.15.89:6789/0 conn(0x7f1cf40701b0 legacy=0x7f1cf406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f1cf27fc640 1 -- 172.21.15.89:0/3606014981 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4071670 con 0x7f1cf4071ba0 2023-08-25T09:42:05.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f592cf08640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280b8440 con 0x7f59280b4c10 2023-08-25T09:42:05.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f592cf08640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592814a780 con 0x7f592814b260 2023-08-25T09:42:05.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f592cf08640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280b50d0 con 0x7f59280b32f0 2023-08-25T09:42:05.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7fd617fff640 1 -- 172.21.15.89:0/4126926983 >> v1:172.21.15.121:6789/0 conn(0x7fd618069ac0 legacy=0x7fd61806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7fd617fff640 1 -- 172.21.15.89:0/4126926983 >> v1:172.21.15.89:6789/0 conn(0x7fd6180b7920 legacy=0x7fd61815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7fd617fff640 1 -- 172.21.15.89:0/4126926983 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180b5e10 con 0x7fd6180708a0 2023-08-25T09:42:05.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5927fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f592814b260 0x7f5928154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:42204/0 (socket says 172.21.15.89:42204) 2023-08-25T09:42:05.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5927fff640 1 -- 172.21.15.89:0/2261627378 learned_addr learned my addr 172.21.15.89:0/2261627378 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:05.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7efd4ffff640 1 -- 172.21.15.89:0/4042389155 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967837165 0 0) 0x7efd58070730 con 0x7efd580b37d0 2023-08-25T09:42:05.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7efd5d46f640 1 -- 172.21.15.89:0/4042389155 >> v2:172.21.15.89:3300/0 conn(0x7efd58142880 msgr2=0x7efd5814bdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T09:42:05.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7efd5d46f640 1 --2- 172.21.15.89:0/4042389155 >> v2:172.21.15.89:3300/0 conn(0x7efd58142880 0x7efd5814bdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7efd5d46f640 1 -- 172.21.15.89:0/4042389155 >> v1:172.21.15.121:6789/0 conn(0x7efd580b37d0 legacy=0x7efd58142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7efd5d46f640 1 -- 172.21.15.89:0/4042389155 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580b5120 con 0x7efd58070ba0 2023-08-25T09:42:05.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.680+0000 7fdaca760640 1 -- start start 2023-08-25T09:42:05.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fdaca760640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdac40b42a0 0x7fdac4149d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fdaca760640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac414ac80 con 0x7fdac40b4df0 2023-08-25T09:42:05.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fdaca760640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac414a350 con 0x7fdac40b3a40 2023-08-25T09:42:05.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7fdaca760640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac414a630 con 0x7fdac40b42a0 2023-08-25T09:42:05.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a83186640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a7c0b8490 0x7f4a7c1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a83186640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a7c149c70 0x7f4a7c14a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a83186640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c14a640 con 0x7f4a7c0bc960 2023-08-25T09:42:05.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a83186640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7c140f10 con 0x7f4a7c0b8490 2023-08-25T09:42:05.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a83186640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7c070810 con 0x7f4a7c149c70 2023-08-25T09:42:05.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f5f0d3cf640 1 Processor -- start 2023-08-25T09:42:05.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.681+0000 7f5f0d3cf640 1 -- start start 2023-08-25T09:42:05.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f0d3cf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5f08069ac0 0x7f5f0814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f0d3cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0806f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f0d3cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f080b7bc0 0x7f5f080b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f0d3cf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0806fd90 con 0x7f5f080b7bc0 2023-08-25T09:42:05.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a81723640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a7c149c70 0x7f4a7c14a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a81723640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a7c149c70 0x7f4a7c14a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:50816/0 (socket says 172.21.15.89:50816) 2023-08-25T09:42:05.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f0d3cf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0806ea20 con 0x7f5f08069ac0 2023-08-25T09:42:05.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f0d3cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0806ed00 con 0x7f5f080711a0 2023-08-25T09:42:05.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f06ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5f08069ac0 0x7f5f0814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f06ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5f08069ac0 0x7f5f0814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:50812/0 (socket says 172.21.15.89:50812) 2023-08-25T09:42:05.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f06ffd640 1 -- 172.21.15.89:0/2291225202 learned_addr learned my addr 172.21.15.89:0/2291225202 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f067fc640 1 --2- 172.21.15.89:0/2291225202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f4a81723640 1 -- 172.21.15.89:0/1964744343 learned_addr learned my addr 172.21.15.89:0/1964744343 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7fbb13fff640 1 -- 172.21.15.89:0/830762257 >> v1:172.21.15.121:6789/0 conn(0x7fbb140b78e0 legacy=0x7fbb14152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7fbb13fff640 1 -- 172.21.15.89:0/830762257 >> v1:172.21.15.89:6789/0 conn(0x7fbb14069ac0 legacy=0x7fbb14144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7fbb13fff640 1 -- 172.21.15.89:0/830762257 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140b8110 con 0x7fbb1406e640 2023-08-25T09:42:05.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f067fc640 1 -- 172.21.15.89:0/2291225202 >> v2:172.21.15.121:3300/0 conn(0x7f5f08069ac0 msgr2=0x7f5f0814eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f5f067fc640 1 --2- 172.21.15.89:0/2291225202 >> v2:172.21.15.121:3300/0 conn(0x7f5f08069ac0 0x7f5f0814eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5f067fc640 1 -- 172.21.15.89:0/2291225202 >> v2:172.21.15.89:3300/0 conn(0x7f5f080b7bc0 msgr2=0x7f5f080b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5f067fc640 1 --2- 172.21.15.89:0/2291225202 >> v2:172.21.15.89:3300/0 conn(0x7f5f080b7bc0 0x7f5f080b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.682+0000 7f59277fe640 1 --2- 172.21.15.89:0/2261627378 >> v2:172.21.15.89:3300/0 conn(0x7f59280b32f0 0x7f59280b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7fdac9f5f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdac40b3a40 0x7fdac41405a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:42216/0 (socket says 172.21.15.89:42216) 2023-08-25T09:42:05.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7fdac9f5f640 1 -- 172.21.15.89:0/4065082800 learned_addr learned my addr 172.21.15.89:0/4065082800 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:05.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277369099 0 0) 0x7f592814a780 con 0x7f592814b260 2023-08-25T09:42:05.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5914003520 con 0x7f592814b260 2023-08-25T09:42:05.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5f067fc640 1 -- 172.21.15.89:0/2291225202 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0806f330 con 0x7f5f080711a0 2023-08-25T09:42:05.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f4a80f22640 1 --2- 172.21.15.89:0/1964744343 >> v2:172.21.15.89:3300/0 conn(0x7f4a7c0b8490 0x7f4a7c1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7fdac8f5d640 1 --2- 172.21.15.89:0/4065082800 >> v2:172.21.15.89:3300/0 conn(0x7fdac40b42a0 0x7fdac4149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1497806350 0 0) 0x7f5914003520 con 0x7f592814b260 2023-08-25T09:42:05.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 >> v2:172.21.15.89:3300/0 conn(0x7f59280b32f0 msgr2=0x7f59280b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 --2- 172.21.15.89:0/2261627378 >> v2:172.21.15.89:3300/0 conn(0x7f59280b32f0 0x7f59280b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 >> v1:172.21.15.89:6789/0 conn(0x7f59280b4c10 legacy=0x7f5928144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592814aa60 con 0x7f592814b260 2023-08-25T09:42:05.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 <== mon.1 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f59200019f0 con 0x7f592814b260 2023-08-25T09:42:05.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 >> v1:172.21.15.121:6789/0 conn(0x7f592814b260 legacy=0x7f5928154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f5914003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59140047c0 0x7f5914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59140051d0 0x7f591400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280b50d0 con 0x7f59140051d0 2023-08-25T09:42:05.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c100 con 0x7f59140039e0 2023-08-25T09:42:05.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c2c0 con 0x7f59140047c0 2023-08-25T09:42:05.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f1cf27fc640 1 --2- 172.21.15.89:0/3606014981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf4069850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40be700 tx=0x7f1cec02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb5a10e11ebbd51 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499467584 0 0) 0x7fdac414a350 con 0x7fdac40b3a40 2023-08-25T09:42:05.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab0003440 con 0x7fdac40b3a40 2023-08-25T09:42:05.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f59277fe640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f5914003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f1cf1ffb640 1 -- 172.21.15.89:0/3606014981 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec02c9f0 con 0x7f1cf4071ba0 2023-08-25T09:42:05.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f1cf1ffb640 1 -- 172.21.15.89:0/3606014981 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec02cb50 con 0x7f1cf4071ba0 2023-08-25T09:42:05.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f1cf1ffb640 1 -- 172.21.15.89:0/3606014981 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec0343f0 con 0x7f1cf4071ba0 2023-08-25T09:42:05.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fbb13fff640 1 --2- 172.21.15.89:0/830762257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb1406e640 0x7fbb1414dbe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e50 tx=0x7fbb0c02c0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f5d12b4b17c7655 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7efd5d46f640 1 --2- 172.21.15.89:0/4042389155 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58070ba0 0x7efd580b3290 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efd50009d90 tx=0x7efd5002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f350fd99c732e83c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4190955525 0 0) 0x7fdab0003440 con 0x7fdac40b3a40 2023-08-25T09:42:05.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 >> v2:172.21.15.89:3300/0 conn(0x7fdac40b42a0 msgr2=0x7fdac4149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 --2- 172.21.15.89:0/4065082800 >> v2:172.21.15.89:3300/0 conn(0x7fdac40b42a0 0x7fdac4149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 >> v1:172.21.15.89:6789/0 conn(0x7fdac40b4df0 legacy=0x7fdac40b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac414a910 con 0x7fdac40b3a40 2023-08-25T09:42:05.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 <== mon.1 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fdac0004cd0 con 0x7fdac40b3a40 2023-08-25T09:42:05.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f5927fff640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59140051d0 0x7f591400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f59277fe640 1 -- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59140047c0 msgr2=0x7f5914004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T09:42:05.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f59277fe640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59140047c0 0x7f5914004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f59277fe640 1 -- 172.21.15.89:0/2261627378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59140051d0 msgr2=0x7f591400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fbb127fc640 1 -- 172.21.15.89:0/830762257 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c02cc40 con 0x7fbb1406e640 2023-08-25T09:42:05.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fbb127fc640 1 -- 172.21.15.89:0/830762257 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c02cda0 con 0x7fbb1406e640 2023-08-25T09:42:05.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fbb127fc640 1 -- 172.21.15.89:0/830762257 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c034610 con 0x7fbb1406e640 2023-08-25T09:42:05.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f59277fe640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59140051d0 0x7f591400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f59277fe640 1 -- 172.21.15.89:0/2261627378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592814aa60 con 0x7f59140039e0 2023-08-25T09:42:05.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f5927fff640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59140051d0 0x7f591400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:05.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f5927fff640 1 -- 172.21.15.89:0/2261627378 reap_dead start 2023-08-25T09:42:05.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fd617fff640 1 --2- 172.21.15.89:0/4126926983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 0x7fd6180711a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00bb30 tx=0x7fd60c02dfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=505f5fd1899b4019 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f4a81723640 1 -- 172.21.15.89:0/1964744343 >> v2:172.21.15.89:3300/0 conn(0x7f4a7c0b8490 msgr2=0x7f4a7c1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f4a81723640 1 --2- 172.21.15.89:0/1964744343 >> v2:172.21.15.89:3300/0 conn(0x7f4a7c0b8490 0x7f4a7c1409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f4a81723640 1 -- 172.21.15.89:0/1964744343 >> v1:172.21.15.89:6789/0 conn(0x7f4a7c0bc960 legacy=0x7f4a7c069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.683+0000 7f4a81723640 1 -- 172.21.15.89:0/1964744343 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c069f60 con 0x7f4a7c149c70 2023-08-25T09:42:05.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7efd4ffff640 1 -- 172.21.15.89:0/4042389155 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5002cd10 con 0x7efd58070ba0 2023-08-25T09:42:05.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7efd4ffff640 1 -- 172.21.15.89:0/4042389155 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5002ce70 con 0x7efd58070ba0 2023-08-25T09:42:05.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7efd4ffff640 1 -- 172.21.15.89:0/4042389155 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50034640 con 0x7efd58070ba0 2023-08-25T09:42:05.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7f5f067fc640 1 --2- 172.21.15.89:0/2291225202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0806f850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5f0806a5f0 tx=0x7f5efc02b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36afb749b9d18ff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 >> v1:172.21.15.121:6789/0 conn(0x7fdac40b3a40 legacy=0x7fdac41405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdab0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdab00088a0 0x7fdab000acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab000b4f0 0x7fdab000d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac414a630 con 0x7fdab000b4f0 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab000e290 con 0x7fdab0003ad0 2023-08-25T09:42:05.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab000e450 con 0x7fdab00088a0 2023-08-25T09:42:05.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdac975e640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdab0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fd6177fe640 1 -- 172.21.15.89:0/4126926983 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c02ed60 con 0x7fd6180708a0 2023-08-25T09:42:05.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fd6177fe640 1 -- 172.21.15.89:0/4126926983 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c032070 con 0x7fd6180708a0 2023-08-25T09:42:05.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fd6177fe640 1 -- 172.21.15.89:0/4126926983 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c038620 con 0x7fd6180708a0 2023-08-25T09:42:05.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.684+0000 7fdac8f5d640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdab00088a0 0x7fdab000acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f1cf9883640 1 -- 172.21.15.89:0/3606014981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 msgr2=0x7f1cf4069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f1cf9883640 1 --2- 172.21.15.89:0/3606014981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf4069850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40be700 tx=0x7f1cec02be50 comp rx=0 tx=0).stop 2023-08-25T09:42:05.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f4a81723640 1 --2- 172.21.15.89:0/1964744343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 0x7f4a7c14a100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c06ace0 tx=0x7f4a7402be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d14b279bf8afd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac9f5f640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab000b4f0 0x7fdab000d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f4a7b7fe640 1 -- 172.21.15.89:0/1964744343 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7402ca30 con 0x7f4a7c149c70 2023-08-25T09:42:05.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f4a7b7fe640 1 -- 172.21.15.89:0/1964744343 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7402cb90 con 0x7f4a7c149c70 2023-08-25T09:42:05.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f4a7b7fe640 1 -- 172.21.15.89:0/1964744343 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740343f0 con 0x7f4a7c149c70 2023-08-25T09:42:05.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f5f05ffb640 1 -- 172.21.15.89:0/2291225202 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc031520 con 0x7f5f080711a0 2023-08-25T09:42:05.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f5f05ffb640 1 -- 172.21.15.89:0/2291225202 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc031680 con 0x7f5f080711a0 2023-08-25T09:42:05.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 -- 172.21.15.89:0/830762257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb1406e640 msgr2=0x7fbb1414dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 --2- 172.21.15.89:0/830762257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb1406e640 0x7fbb1414dbe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e50 tx=0x7fbb0c02c0a0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f5f05ffb640 1 -- 172.21.15.89:0/2291225202 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc031a50 con 0x7f5f080711a0 2023-08-25T09:42:05.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 -- 172.21.15.89:0/830762257 shutdown_connections 2023-08-25T09:42:05.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 --2- 172.21.15.89:0/830762257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb1406e640 0x7fbb1414dbe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 -- 172.21.15.89:0/830762257 >> 172.21.15.89:0/830762257 conn(0x7fbb140bbe70 msgr2=0x7fbb140bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4042389155 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58070ba0 msgr2=0x7efd580b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7efd5f6d3640 1 --2- 172.21.15.89:0/4042389155 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58070ba0 0x7efd580b3290 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efd50009d90 tx=0x7efd5002bf60 comp rx=0 tx=0).stop 2023-08-25T09:42:05.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 -- 172.21.15.89:0/830762257 shutdown_connections 2023-08-25T09:42:05.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac975e640 1 -- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdab00088a0 msgr2=0x7fdab000acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac975e640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdab00088a0 0x7fdab000acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac975e640 1 -- 172.21.15.89:0/4065082800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab000b4f0 msgr2=0x7fdab000d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:05.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac975e640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab000b4f0 0x7fdab000d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac975e640 1 -- 172.21.15.89:0/4065082800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac414a910 con 0x7fdab0003ad0 2023-08-25T09:42:05.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fbb19dc2640 1 -- 172.21.15.89:0/830762257 wait complete. 2023-08-25T09:42:05.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7f59277fe640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f5914003e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f591800ba30 tx=0x7f59140057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d63b5e6e4e7f43ae server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac9f5f640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab000b4f0 0x7fdab000d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:05.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fdac9f5f640 1 -- 172.21.15.89:0/4065082800 reap_dead start 2023-08-25T09:42:05.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fd61f087640 1 -- 172.21.15.89:0/4126926983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 msgr2=0x7fd6180711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fd61f087640 1 --2- 172.21.15.89:0/4126926983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 0x7fd6180711a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00bb30 tx=0x7fd60c02dfb0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4042389155 shutdown_connections 2023-08-25T09:42:05.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7efd5f6d3640 1 --2- 172.21.15.89:0/4042389155 >> v2:172.21.15.89:3300/0 conn(0x7efd58142880 0x7efd5814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7efd5f6d3640 1 --2- 172.21.15.89:0/4042389155 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58070ba0 0x7efd580b3290 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4042389155 >> 172.21.15.89:0/4042389155 conn(0x7efd580bbe70 msgr2=0x7efd580bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fd61f087640 1 -- 172.21.15.89:0/4126926983 shutdown_connections 2023-08-25T09:42:05.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fd61f087640 1 --2- 172.21.15.89:0/4126926983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180708a0 0x7fd6180711a0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00bb30 tx=0x7fd60c02dfb0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.685+0000 7fd61f087640 1 -- 172.21.15.89:0/4126926983 >> 172.21.15.89:0/4126926983 conn(0x7fd6180bbe70 msgr2=0x7fd6180bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7fd61f087640 1 -- 172.21.15.89:0/4126926983 shutdown_connections 2023-08-25T09:42:05.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7fd61f087640 1 -- 172.21.15.89:0/4126926983 wait complete. 2023-08-25T09:42:05.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918032660 con 0x7f59140039e0 2023-08-25T09:42:05.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59180327c0 con 0x7f59140039e0 2023-08-25T09:42:05.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f5926ffd640 1 -- 172.21.15.89:0/2261627378 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918032b90 con 0x7f59140039e0 2023-08-25T09:42:05.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4042389155 shutdown_connections 2023-08-25T09:42:05.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f1cf9883640 1 -- 172.21.15.89:0/3606014981 shutdown_connections 2023-08-25T09:42:05.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f1cf9883640 1 --2- 172.21.15.89:0/3606014981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf4069850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f1cf9883640 1 --2- 172.21.15.89:0/3606014981 >> v2:172.21.15.89:3300/0 conn(0x7f1cf4071290 0x7f1cf414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f1cf9883640 1 -- 172.21.15.89:0/3606014981 >> 172.21.15.89:0/3606014981 conn(0x7f1cf40bd840 msgr2=0x7f1cf40bdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f1cf9883640 1 -- 172.21.15.89:0/3606014981 shutdown_connections 2023-08-25T09:42:05.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f1cf9883640 1 -- 172.21.15.89:0/3606014981 wait complete. 2023-08-25T09:42:05.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/2291225202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 msgr2=0x7f5f0806f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/2291225202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0806f850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5f0806a5f0 tx=0x7f5efc02b7c0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 -- 172.21.15.89:0/1964744343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 msgr2=0x7f4a7c14a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 --2- 172.21.15.89:0/1964744343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 0x7f4a7c14a100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c06ace0 tx=0x7f4a7402be90 comp rx=0 tx=0).stop 2023-08-25T09:42:05.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 -- 172.21.15.89:0/1964744343 shutdown_connections 2023-08-25T09:42:05.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 --2- 172.21.15.89:0/1964744343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 0x7f4a7c14a100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 --2- 172.21.15.89:0/1964744343 >> v2:172.21.15.89:3300/0 conn(0x7f4a7c0b8490 0x7f4a7c1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 -- 172.21.15.89:0/1964744343 >> 172.21.15.89:0/1964744343 conn(0x7f4a7c0bbe70 msgr2=0x7f4a7c0bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 -- 172.21.15.89:0/1964744343 shutdown_connections 2023-08-25T09:42:05.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7fdac975e640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdab0003ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001e50 tx=0x7fdab00036f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2763dff77ea5e31 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc003b70 con 0x7fdab0003ad0 2023-08-25T09:42:05.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc003cd0 con 0x7fdab0003ad0 2023-08-25T09:42:05.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fdabbfff640 1 -- 172.21.15.89:0/4065082800 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc005310 con 0x7fdab0003ad0 2023-08-25T09:42:05.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f592cf08640 1 -- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 msgr2=0x7f5914003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f592cf08640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f5914003e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f591800ba30 tx=0x7f59140057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fbb19dc2640 1 Processor -- start 2023-08-25T09:42:05.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/2291225202 shutdown_connections 2023-08-25T09:42:05.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/2291225202 >> v2:172.21.15.89:3300/0 conn(0x7f5f080b7bc0 0x7f5f080b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/2291225202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0806f850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/2291225202 >> v2:172.21.15.121:3300/0 conn(0x7f5f08069ac0 0x7f5f0814eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/2291225202 >> 172.21.15.89:0/2291225202 conn(0x7f5f080bbe70 msgr2=0x7f5f080bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4042389155 wait complete. 2023-08-25T09:42:05.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fd61f087640 1 Processor -- start 2023-08-25T09:42:05.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fd61f087640 1 -- start start 2023-08-25T09:42:05.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f592cf08640 1 -- 172.21.15.89:0/2261627378 shutdown_connections 2023-08-25T09:42:05.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f592cf08640 1 --2- 172.21.15.89:0/2261627378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f5914003e00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f592cf08640 1 -- 172.21.15.89:0/2261627378 >> 172.21.15.89:0/2261627378 conn(0x7f5928069c40 msgr2=0x7f592806a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fbb19dc2640 1 -- start start 2023-08-25T09:42:05.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.686+0000 7f4a83186640 1 -- 172.21.15.89:0/1964744343 wait complete. 2023-08-25T09:42:05.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/2291225202 shutdown_connections 2023-08-25T09:42:05.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7efd5f6d3640 1 Processor -- start 2023-08-25T09:42:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f1cf9883640 1 Processor -- start 2023-08-25T09:42:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fdaca760640 1 -- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 msgr2=0x7fdab0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7fdaca760640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdab0003ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001e50 tx=0x7fdab00036f0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7efd5f6d3640 1 -- start start 2023-08-25T09:42:05.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7f1cf9883640 1 -- start start 2023-08-25T09:42:05.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7f4a83186640 1 Processor -- start 2023-08-25T09:42:05.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7f592cf08640 1 -- 172.21.15.89:0/2261627378 shutdown_connections 2023-08-25T09:42:05.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7f592cf08640 1 -- 172.21.15.89:0/2261627378 wait complete. 2023-08-25T09:42:05.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb19dc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb14069ac0 0x7fbb14147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.687+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/2291225202 wait complete. 2023-08-25T09:42:05.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61f087640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd618069ac0 0x7fd6180b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61f087640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6180b7920 0x7fd6180b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61f087640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180b3550 0x7fd6181f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61f087640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180b6ea0 con 0x7fd618069ac0 2023-08-25T09:42:05.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61f087640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181e2c70 con 0x7fd6180b7920 2023-08-25T09:42:05.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61f087640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181e5d10 con 0x7fd6180b3550 2023-08-25T09:42:05.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb19dc2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb1406e640 0x7fbb140ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb19dc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb140b78e0 0x7fbb14146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61ce23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd618069ac0 0x7fd6180b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61ce23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd618069ac0 0x7fd6180b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59468/0 (socket says 172.21.15.89:59468) 2023-08-25T09:42:05.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61ce23640 1 -- 172.21.15.89:0/3002773671 learned_addr learned my addr 172.21.15.89:0/3002773671 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd617fff640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6180b7920 0x7fd6180b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fd61d624640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180b3550 0x7fd6181f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb14069ac0 0x7fbb14147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb14069ac0 0x7fbb14147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33068/0 (socket says 172.21.15.89:33068) 2023-08-25T09:42:05.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb137fe640 1 -- 172.21.15.89:0/766109110 learned_addr learned my addr 172.21.15.89:0/766109110 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.688+0000 7fbb13fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb140b78e0 0x7fbb14146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5f6d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd58070ba0 0x7efd58136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fdaca760640 1 -- 172.21.15.89:0/4065082800 shutdown_connections 2023-08-25T09:42:05.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fdaca760640 1 --2- 172.21.15.89:0/4065082800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdab0003ef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fdaca760640 1 -- 172.21.15.89:0/4065082800 >> 172.21.15.89:0/4065082800 conn(0x7fdac4069c40 msgr2=0x7fdac406a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140ba800 con 0x7fbb140b78e0 2023-08-25T09:42:05.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f4a83186640 1 -- start start 2023-08-25T09:42:05.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14144e20 con 0x7fbb14069ac0 2023-08-25T09:42:05.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf9883640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1cf40701b0 0x7f1cf4149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf9883640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4071290 0x7f1cf40b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf9883640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf41e39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf9883640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf414a140 con 0x7f1cf4071290 2023-08-25T09:42:05.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf9883640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40b6a80 con 0x7f1cf4071ba0 2023-08-25T09:42:05.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf9883640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf414c5e0 con 0x7f1cf40701b0 2023-08-25T09:42:05.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd617fff640 1 -- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180b3550 msgr2=0x7fd6181f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd617fff640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180b3550 0x7fd6181f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd617fff640 1 -- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd618069ac0 msgr2=0x7fd6180b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd617fff640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd618069ac0 0x7fd6180b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd617fff640 1 -- 172.21.15.89:0/3002773671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c00b760 con 0x7fd6180b7920 2023-08-25T09:42:05.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd61d624640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6180b3550 0x7fd6181f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:05.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14145070 con 0x7fbb1406e640 2023-08-25T09:42:05.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5d46f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd58070ba0 0x7efd58136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5d46f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd58070ba0 0x7efd58136fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59494/0 (socket says 172.21.15.89:59494) 2023-08-25T09:42:05.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5d46f640 1 -- 172.21.15.89:0/4133675096 learned_addr learned my addr 172.21.15.89:0/4133675096 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f5f0d3cf640 1 Processor -- start 2023-08-25T09:42:05.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5f6d3640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd580b37d0 0x7efd58148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf41e39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf41e39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33084/0 (socket says 172.21.15.89:33084) 2023-08-25T09:42:05.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf3fff640 1 -- 172.21.15.89:0/2786708917 learned_addr learned my addr 172.21.15.89:0/2786708917 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fd617fff640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6180b7920 0x7fd6180b4040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd60c036000 tx=0x7fd60c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5f6d3640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58142880 0x7efd581e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fdaca760640 1 -- 172.21.15.89:0/4065082800 shutdown_connections 2023-08-25T09:42:05.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf2ffd640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1cf40701b0 0x7f1cf4149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f1cf27fc640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4071290 0x7f1cf40b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f592cf08640 1 Processor -- start 2023-08-25T09:42:05.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5cc6e640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd580b37d0 0x7efd58148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58147220 con 0x7efd58070ba0 2023-08-25T09:42:05.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58142880 0x7efd581e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581488d0 con 0x7efd580b37d0 2023-08-25T09:42:05.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd58137620 con 0x7efd58142880 2023-08-25T09:42:05.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f1cf2ffd640 1 -- 172.21.15.89:0/2786708917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 msgr2=0x7f1cf41e39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f1cf2ffd640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf4071ba0 0x7f1cf41e39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f1cf2ffd640 1 -- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4071290 msgr2=0x7f1cf40b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f1cf2ffd640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cf4071290 0x7f1cf40b6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f1cf2ffd640 1 -- 172.21.15.89:0/2786708917 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec009b30 con 0x7f1cf40701b0 2023-08-25T09:42:05.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f4a83186640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a7c0b8490 0x7f4a7c142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f4a83186640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a7c0bc960 0x7f4a7c1ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f4a83186640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 0x7f4a7c1469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f4a83186640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c141050 con 0x7f4a7c0bc960 2023-08-25T09:42:05.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f4a83186640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c142b10 con 0x7f4a7c149c70 2023-08-25T09:42:05.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f4a83186640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0b58a0 con 0x7f4a7c0b8490 2023-08-25T09:42:05.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7fdaca760640 1 -- 172.21.15.89:0/4065082800 wait complete. 2023-08-25T09:42:05.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbb137fe640 1 -- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb1406e640 msgr2=0x7fbb140ba2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T09:42:05.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbb137fe640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb1406e640 0x7fbb140ba2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbb137fe640 1 -- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb140b78e0 msgr2=0x7fbb14146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbb137fe640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb140b78e0 0x7fbb14146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbb137fe640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c009b30 con 0x7fbb14069ac0 2023-08-25T09:42:05.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbb137fe640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb14069ac0 0x7fbb14147750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c400 tx=0x7fbb0400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.689+0000 7f5f0d3cf640 1 -- start start 2023-08-25T09:42:05.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 -- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd580b37d0 msgr2=0x7efd58148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd580b37d0 0x7efd58148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 -- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd58070ba0 msgr2=0x7efd58136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd58070ba0 0x7efd58136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009a70 con 0x7efd58142880 2023-08-25T09:42:05.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004030 con 0x7fd6180b7920 2023-08-25T09:42:05.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c0041d0 con 0x7fd6180b7920 2023-08-25T09:42:05.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c003610 con 0x7fd6180b7920 2023-08-25T09:42:05.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fd61f087640 1 -- 172.21.15.89:0/3002773671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6180b30c0 con 0x7fd6180b7920 2023-08-25T09:42:05.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fd61f087640 1 -- 172.21.15.89:0/3002773671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6180b4ec0 con 0x7fd6180b7920 2023-08-25T09:42:05.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f5f0d3cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f08069ac0 0x7f5f08155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f5f0d3cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f5f0d3cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f080b7bc0 0x7f5f08158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f5f0d3cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08155d90 con 0x7f5f080b7bc0 2023-08-25T09:42:05.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f5f0d3cf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08156bb0 con 0x7f5f08069ac0 2023-08-25T09:42:05.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f5f0d3cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08156e50 con 0x7f5f080711a0 2023-08-25T09:42:05.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040052d0 con 0x7fbb14069ac0 2023-08-25T09:42:05.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04005430 con 0x7fbb14069ac0 2023-08-25T09:42:05.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5f067fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7efd5dc70640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58142880 0x7efd581e77d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd4800b410 tx=0x7efd4800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5f06ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f08069ac0 0x7f5f08155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5f067fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0814cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49212/0 (socket says 172.21.15.89:49212) 2023-08-25T09:42:05.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5f067fc640 1 -- 172.21.15.89:0/1528523295 learned_addr learned my addr 172.21.15.89:0/1528523295 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5f077fe640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f080b7bc0 0x7f5f08158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb14146300 con 0x7fbb14069ac0 2023-08-25T09:42:05.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04007260 con 0x7fbb14069ac0 2023-08-25T09:42:05.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb140b53b0 con 0x7fbb14069ac0 2023-08-25T09:42:05.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f1cf2ffd640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1cf40701b0 0x7f1cf4149c00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400d5f0 tx=0x7f1ce400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f592cf08640 1 -- start start 2023-08-25T09:42:05.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f592cf08640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f592814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f592cf08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f592814b7a0 0x7f592814bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f592cf08640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59281e77f0 0x7f59281e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f592cf08640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592814e8a0 con 0x7f592814b7a0 2023-08-25T09:42:05.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.690+0000 7f592cf08640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592814e420 con 0x7f59140039e0 2023-08-25T09:42:05.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f592cf08640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5928070c40 con 0x7f59281e77f0 2023-08-25T09:42:05.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7fdaca760640 1 Processor -- start 2023-08-25T09:42:05.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40125f0 con 0x7f1cf40701b0 2023-08-25T09:42:05.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f4a80f22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a7c0b8490 0x7f4a7c142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f4a80f22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a7c0b8490 0x7f4a7c142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49216/0 (socket says 172.21.15.89:49216) 2023-08-25T09:42:05.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f4a80f22640 1 -- 172.21.15.89:0/121478662 learned_addr learned my addr 172.21.15.89:0/121478662 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4012750 con 0x7f1cf40701b0 2023-08-25T09:42:05.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4012b00 con 0x7f1cf40701b0 2023-08-25T09:42:05.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f59277fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f592814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5927fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59281e77f0 0x7f59281e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf414b0e0 con 0x7f1cf40701b0 2023-08-25T09:42:05.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48011830 con 0x7efd58142880 2023-08-25T09:42:05.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48011990 con 0x7efd58142880 2023-08-25T09:42:05.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48011d40 con 0x7efd58142880 2023-08-25T09:42:05.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a7c0bc960 0x7f4a7c1ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5927fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59281e77f0 0x7f59281e7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49222/0 (socket says 172.21.15.89:49222) 2023-08-25T09:42:05.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7f5927fff640 1 -- 172.21.15.89:0/2325177142 learned_addr learned my addr 172.21.15.89:0/2325177142 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f5f067fc640 1 -- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f08069ac0 msgr2=0x7f5f08155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f5f067fc640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f08069ac0 0x7f5f08155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f5f067fc640 1 -- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f080b7bc0 msgr2=0x7f5f08158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f5f067fc640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f080b7bc0 0x7f5f08158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f5f067fc640 1 -- 172.21.15.89:0/1528523295 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc009400 con 0x7f5f080711a0 2023-08-25T09:42:05.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd58147600 con 0x7efd58142880 2023-08-25T09:42:05.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd58146eb0 con 0x7efd58142880 2023-08-25T09:42:05.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f591ffff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f592814b7a0 0x7f592814bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f4a7bfff640 1 -- 172.21.15.89:0/121478662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a7c0b8490 msgr2=0x7f4a7c142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a7c0b8490 0x7f4a7c142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f4a7bfff640 1 -- 172.21.15.89:0/121478662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 msgr2=0x7f4a7c1469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a7c149c70 0x7f4a7c1469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f4a7bfff640 1 -- 172.21.15.89:0/121478662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74009b30 con 0x7f4a7c0bc960 2023-08-25T09:42:05.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f591ffff640 1 -- 172.21.15.89:0/2325177142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59281e77f0 msgr2=0x7f59281e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fd61f087640 1 -- 172.21.15.89:0/3002773671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd61806fa50 con 0x7fd6180b7920 2023-08-25T09:42:05.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.691+0000 7fdaca760640 1 -- start start 2023-08-25T09:42:05.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fdaca760640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdac406f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fdaca760640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdac4141150 0x7fdac41e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fdaca760640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac4148e10 0x7fdac41465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fdaca760640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4149290 con 0x7fdac4148e10 2023-08-25T09:42:05.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fdaca760640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4141e00 con 0x7fdab0003ad0 2023-08-25T09:42:05.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7fdaca760640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406ed00 con 0x7fdac4141150 2023-08-25T09:42:05.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdac406f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac8f5d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdac4141150 0x7fdac41e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f591ffff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59281e77f0 0x7f59281e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f591ffff640 1 -- 172.21.15.89:0/2325177142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 msgr2=0x7f592814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f591ffff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f592814dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f591ffff640 1 -- 172.21.15.89:0/2325177142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928071590 con 0x7f592814b7a0 2023-08-25T09:42:05.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f59277fe640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59140039e0 0x7f592814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:05.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f5927fff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59281e77f0 0x7f59281e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:05.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f5f067fc640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0814cfc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009890 tx=0x7f5efc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd60c003770 con 0x7fd6180b7920 2023-08-25T09:42:05.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.692+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf414ba80 con 0x7f1cf40701b0 2023-08-25T09:42:05.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac8f5d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdac4141150 0x7fdac41e7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49232/0 (socket says 172.21.15.89:49232) 2023-08-25T09:42:05.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac8f5d640 1 -- 172.21.15.89:0/1308727860 learned_addr learned my addr 172.21.15.89:0/1308727860 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:05.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f591ffff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f592814b7a0 0x7f592814bc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f59280613f0 tx=0x7f591000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb14069ea0 con 0x7fbb14069ac0 2023-08-25T09:42:05.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd580b4df0 con 0x7efd58142880 2023-08-25T09:42:05.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f4a7bfff640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a7c0bc960 0x7f4a7c1ef660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0bcd80 tx=0x7f4a7000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac9f5f640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac4148e10 0x7fdac41465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fd6157fa640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd60406a0a0 0x7fd60406c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb040073c0 con 0x7fbb14069ac0 2023-08-25T09:42:05.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 -- 172.21.15.89:0/1308727860 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdac4141150 msgr2=0x7fdac41e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdac4141150 0x7fdac41e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 -- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac4148e10 msgr2=0x7fdac41465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac4148e10 0x7fdac41465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 -- 172.21.15.89:0/1308727860 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac406efe0 con 0x7fdab0003ad0 2023-08-25T09:42:05.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd60c0aa8f0 con 0x7fd6180b7920 2023-08-25T09:42:05.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fd6157fa640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] conn(0x7fd604072960 0x7fd604074d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 --> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd604075430 con 0x7fd604072960 2023-08-25T09:42:05.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd60c0af2c0 con 0x7fd6180b7920 2023-08-25T09:42:05.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc031520 con 0x7f5f080711a0 2023-08-25T09:42:05.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc033c50 con 0x7f5f080711a0 2023-08-25T09:42:05.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc006e10 con 0x7f5f080711a0 2023-08-25T09:42:05.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7fdac975e640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdac406f7e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdabc004000 tx=0x7fdabc0014a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70005220 con 0x7f4a7c0bc960 2023-08-25T09:42:05.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70005380 con 0x7f4a7c0bc960 2023-08-25T09:42:05.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.693+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700054f0 con 0x7f4a7c0bc960 2023-08-25T09:42:05.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7f4a83186640 1 -- 172.21.15.89:0/121478662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c0b5b80 con 0x7f4a7c0bc960 2023-08-25T09:42:05.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7f4a83186640 1 -- 172.21.15.89:0/121478662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c1efba0 con 0x7f4a7c0bc960 2023-08-25T09:42:05.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cf4069e50 con 0x7f1cf40701b0 2023-08-25T09:42:05.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ce4012c60 con 0x7f1cf40701b0 2023-08-25T09:42:05.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100052d0 con 0x7f592814b7a0 2023-08-25T09:42:05.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910005430 con 0x7f592814b7a0 2023-08-25T09:42:05.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910003830 con 0x7f592814b7a0 2023-08-25T09:42:05.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fbafbfff640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb0006a0a0 0x7fbb0006c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb040878d0 con 0x7fbb14069ac0 2023-08-25T09:42:05.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fbb12ffd640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb0006a0a0 0x7fbb0006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fbafbfff640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] conn(0x7fbb00072860 0x7fbb00074c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb00075330 con 0x7fbb00072860 2023-08-25T09:42:05.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb0408c2c0 con 0x7fbb14069ac0 2023-08-25T09:42:05.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f08157130 con 0x7f5f080711a0 2023-08-25T09:42:05.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f08159130 con 0x7f5f080711a0 2023-08-25T09:42:05.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.694+0000 7fd61ce23640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd60406a0a0 0x7fd60406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fd61d624640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] conn(0x7fd604072960 0x7fd604074d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fbb13fff640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] conn(0x7fbb00072860 0x7fbb00074c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fbb12ffd640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb0006a0a0 0x7fbb0006c560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb08000f60 tx=0x7fbb080079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd4801a400 con 0x7efd58142880 2023-08-25T09:42:05.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7efd4dffb640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7efd3c06a120 0x7efd3c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd48088ac0 con 0x7efd58142880 2023-08-25T09:42:05.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7efd4dffb640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] conn(0x7efd3c0729e0 0x7efd3c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd3c0754b0 con 0x7efd3c0729e0 2023-08-25T09:42:05.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd48088e70 con 0x7efd58142880 2023-08-25T09:42:05.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc03e070 con 0x7fdab0003ad0 2023-08-25T09:42:05.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc005820 con 0x7fdab0003ad0 2023-08-25T09:42:05.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc003e40 con 0x7fdab0003ad0 2023-08-25T09:42:05.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac406f2c0 con 0x7fdab0003ad0 2023-08-25T09:42:05.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f1cdbfff640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1ce006a050 0x7f1ce006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f08069ea0 con 0x7f5f080711a0 2023-08-25T09:42:05.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7efd5cc6e640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] conn(0x7efd3c0729e0 0x7efd3c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.823 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac4149ac0 con 0x7fdab0003ad0 2023-08-25T09:42:05.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f592cf08640 1 -- 172.21.15.89:0/2325177142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5928071260 con 0x7f592814b7a0 2023-08-25T09:42:05.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f592cf08640 1 -- 172.21.15.89:0/2325177142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5928070e40 con 0x7f592814b7a0 2023-08-25T09:42:05.824 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7fbb13fff640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] conn(0x7fbb00072860 0x7fbb00074c80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ce4088930 con 0x7f1cf40701b0 2023-08-25T09:42:05.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f1cdbfff640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] conn(0x7f1ce0072890 0x7f1ce0074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 --> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ce0075360 con 0x7f1ce0072890 2023-08-25T09:42:05.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7f4a83186640 1 -- 172.21.15.89:0/121478662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a7c06fa90 con 0x7f4a7c0bc960 2023-08-25T09:42:05.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f592cf08640 1 -- 172.21.15.89:0/2325177142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59280b36d0 con 0x7f592814b7a0 2023-08-25T09:42:05.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fd61d624640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] conn(0x7fd604072960 0x7fd604074d80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.695+0000 7fd61ce23640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd60406a0a0 0x7fd60406c560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd610007fd0 tx=0x7fd610009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7efd5cc6e640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] conn(0x7efd3c0729e0 0x7efd3c074e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== osd.7 v2:172.21.15.121:6824/1918858390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd604075430 con 0x7fd604072960 2023-08-25T09:42:05.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5efc03a040 con 0x7f5f080711a0 2023-08-25T09:42:05.827 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f1cf27fc640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1ce006a050 0x7f1ce006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ce4012f10 con 0x7f1cf40701b0 2023-08-25T09:42:05.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f1cf3fff640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] conn(0x7f1ce0072890 0x7f1ce0074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7efd5d46f640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7efd3c06a120 0x7efd3c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== osd.4 v2:172.21.15.121:6800/2911303023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbb00075330 con 0x7fbb00072860 2023-08-25T09:42:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.696+0000 7f5eef7fe640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5ef406a120 0x7f5ef406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.831 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f1cf3fff640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] conn(0x7f1ce0072890 0x7f1ce0074cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5efc0a9cd0 con 0x7f5f080711a0 2023-08-25T09:42:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f5eef7fe640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] conn(0x7f5ef40729e0 0x7f5ef4074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 --> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ef40754b0 con 0x7f5ef40729e0 2023-08-25T09:42:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5efc0ac2f0 con 0x7f5f080711a0 2023-08-25T09:42:05.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f1cf27fc640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1ce006a050 0x7f1ce006c510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cec035000 tx=0x7f1cec030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== osd.6 v2:172.21.15.121:6816/1927368611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efd3c0754b0 con 0x7efd3c0729e0 2023-08-25T09:42:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdac4149d40 con 0x7fdab0003ad0 2023-08-25T09:42:05.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7efd5d46f640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7efd3c06a120 0x7efd3c06c5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd50000f80 tx=0x7efd50030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f5f077fe640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] conn(0x7f5ef40729e0 0x7f5ef4074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.697+0000 7f5f06ffd640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5ef406a120 0x7f5ef406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f5f06ffd640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5ef406a120 0x7f5ef406c5e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f00011340 tx=0x7f5f0000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f5f077fe640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] conn(0x7f5ef40729e0 0x7f5ef4074e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== osd.0 v2:172.21.15.89:6808/857596072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1ce0075360 con 0x7f1ce0072890 2023-08-25T09:42:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a70007250 con 0x7f4a7c0bc960 2023-08-25T09:42:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f4a797fa640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4a6806a0d0 0x7f4a6806c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a70088010 con 0x7f4a7c0bc960 2023-08-25T09:42:05.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.698+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5910003990 con 0x7f592814b7a0 2023-08-25T09:42:05.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f4a797fa640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] conn(0x7f4a68072990 0x7f4a68074db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 --> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a68075460 con 0x7f4a68072990 2023-08-25T09:42:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a700884b0 con 0x7f4a7c0bc960 2023-08-25T09:42:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f4a81723640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] conn(0x7f4a68072990 0x7f4a68074db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f5924ff9640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f590806a0a0 0x7f590806c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5910088110 con 0x7f592814b7a0 2023-08-25T09:42:05.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f5924ff9640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] conn(0x7f5908072960 0x7f5908074d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 --> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5908075430 con 0x7f5908072960 2023-08-25T09:42:05.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5910088480 con 0x7f592814b7a0 2023-08-25T09:42:05.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdabc007030 con 0x7fdab0003ad0 2023-08-25T09:42:05.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7fdab9ffb640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fdaa806a050 0x7fdaa806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f4a80f22640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4a6806a0d0 0x7f4a6806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7f4a80f22640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4a6806a0d0 0x7f4a6806c590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009b60 tx=0x7f4a6c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7f4a81723640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] conn(0x7f4a68072990 0x7f4a68074db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdabc0aaaa0 con 0x7fdab0003ad0 2023-08-25T09:42:05.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7fdab9ffb640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] conn(0x7fdaa8072890 0x7fdaa8074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:05.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 --> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaa8075360 con 0x7fdaa8072890 2023-08-25T09:42:05.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdabc0aae10 con 0x7fdab0003ad0 2023-08-25T09:42:05.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.699+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== osd.5 v2:172.21.15.121:6808/3864449918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5ef40754b0 con 0x7f5ef40729e0 2023-08-25T09:42:05.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7fdac9f5f640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] conn(0x7fdaa8072890 0x7fdaa8074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7f59277fe640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f590806a0a0 0x7f590806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.700+0000 7f5927fff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] conn(0x7f5908072960 0x7f5908074d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.702+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== osd.1 v2:172.21.15.89:6800/2492565919 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4a68075460 con 0x7f4a68072990 2023-08-25T09:42:05.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.702+0000 7fdac9f5f640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] conn(0x7fdaa8072890 0x7fdaa8074cb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.703+0000 7f5927fff640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] conn(0x7f5908072960 0x7f5908074d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.703+0000 7f59277fe640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f590806a0a0 0x7f590806c560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f591800ba00 tx=0x7f591803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.703+0000 7fdac8f5d640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fdaa806a050 0x7fdaa806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:05.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.704+0000 7fdac8f5d640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fdaa806a050 0x7fdaa806c510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac41e2070 tx=0x7fdab4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:05.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.704+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== osd.3 v2:172.21.15.89:6812/2349821925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5908075430 con 0x7f5908072960 2023-08-25T09:42:05.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.704+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== osd.2 v2:172.21.15.89:6815/1353688289 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdaa8075360 con 0x7fdaa8072890 2023-08-25T09:42:05.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.726+0000 7fd61f087640 1 -- 172.21.15.89:0/3002773671 --> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6180b60f0 con 0x7fd604072960 2023-08-25T09:42:05.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.727+0000 7fd6157fa640 1 -- 172.21.15.89:0/3002773671 <== osd.7 v2:172.21.15.121:6824/1918858390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6080017b0 con 0x7fd604072960 2023-08-25T09:42:05.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.727+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] conn(0x7fd604072960 msgr2=0x7fd604074d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.727+0000 7fd5feffd640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:6824/1918858390,v1:172.21.15.121:6825/1918858390] conn(0x7fd604072960 0x7fd604074d80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.727+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd60406a0a0 msgr2=0x7fd60406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd60406a0a0 0x7fd60406c560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd610007fd0 tx=0x7fd610009040 comp rx=0 tx=0).stop 2023-08-25T09:42:05.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6180b7920 msgr2=0x7fd6180b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 --2- 172.21.15.89:0/3002773671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6180b7920 0x7fd6180b4040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd60c036000 tx=0x7fd60c0046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 --> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1cf414ef60 con 0x7f1ce0072890 2023-08-25T09:42:05.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd61d624640 1 -- 172.21.15.89:0/3002773671 reap_dead start 2023-08-25T09:42:05.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7efd5f6d3640 1 -- 172.21.15.89:0/4133675096 --> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd580b56e0 con 0x7efd3c0729e0 2023-08-25T09:42:05.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 shutdown_connections 2023-08-25T09:42:05.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 >> 172.21.15.89:0/3002773671 conn(0x7fd6180bbe70 msgr2=0x7fd6181e6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 shutdown_connections 2023-08-25T09:42:05.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.728+0000 7fd5feffd640 1 -- 172.21.15.89:0/3002773671 wait complete. 2023-08-25T09:42:05.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.729+0000 7f1cdbfff640 1 -- 172.21.15.89:0/2786708917 <== osd.0 v2:172.21.15.89:6808/857596072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ce8005100 con 0x7f1ce0072890 2023-08-25T09:42:05.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.729+0000 7efd4dffb640 1 -- 172.21.15.89:0/4133675096 <== osd.6 v2:172.21.15.121:6816/1927368611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd540072e0 con 0x7efd3c0729e0 2023-08-25T09:42:05.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.729+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 --> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb1404dbd0 con 0x7fbb00072860 2023-08-25T09:42:05.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.729+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] conn(0x7f1ce0072890 msgr2=0x7f1ce0074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.729+0000 7f1cf9883640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6808/857596072,v1:172.21.15.89:6809/857596072] conn(0x7f1ce0072890 0x7f1ce0074cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.729+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1ce006a050 msgr2=0x7f1ce006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf9883640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f1ce006a050 0x7f1ce006c510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cec035000 tx=0x7f1cec030000 comp rx=0 tx=0).stop 2023-08-25T09:42:05.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1cf40701b0 msgr2=0x7f1cf4149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7fbafbfff640 1 -- 172.21.15.89:0/766109110 <== osd.4 v2:172.21.15.121:6800/2911303023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb1404dbd0 con 0x7fbb00072860 2023-08-25T09:42:05.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf9883640 1 --2- 172.21.15.89:0/2786708917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1cf40701b0 0x7f1cf4149c00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400d5f0 tx=0x7f1ce400dab0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf3fff640 1 -- 172.21.15.89:0/2786708917 reap_dead start 2023-08-25T09:42:05.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 shutdown_connections 2023-08-25T09:42:05.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] conn(0x7fbb00072860 msgr2=0x7fbb00074c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7fbb19dc2640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:6800/2911303023,v1:172.21.15.121:6801/2911303023] conn(0x7fbb00072860 0x7fbb00074c80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 >> 172.21.15.89:0/2786708917 conn(0x7f1cf40bd840 msgr2=0x7f1cf40bcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb0006a0a0 msgr2=0x7fbb0006c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7fbb19dc2640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb0006a0a0 0x7fbb0006c560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb08000f60 tx=0x7fbb080079b0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 shutdown_connections 2023-08-25T09:42:05.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.730+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb14069ac0 msgr2=0x7fbb14147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7fbb19dc2640 1 --2- 172.21.15.89:0/766109110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb14069ac0 0x7fbb14147750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c400 tx=0x7fbb0400c8c0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7f1cf9883640 1 -- 172.21.15.89:0/2786708917 wait complete. 2023-08-25T09:42:05.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7fbb13fff640 1 -- 172.21.15.89:0/766109110 reap_dead start 2023-08-25T09:42:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 shutdown_connections 2023-08-25T09:42:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 >> 172.21.15.89:0/766109110 conn(0x7fbb140bbe70 msgr2=0x7fbb1414d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 --> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f0806efe0 con 0x7f5ef40729e0 2023-08-25T09:42:05.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 shutdown_connections 2023-08-25T09:42:05.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7fbb19dc2640 1 -- 172.21.15.89:0/766109110 wait complete. 2023-08-25T09:42:05.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] conn(0x7efd3c0729e0 msgr2=0x7efd3c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7efd3b7fe640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:6816/1927368611,v1:172.21.15.121:6817/1927368611] conn(0x7efd3c0729e0 0x7efd3c074e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7f5eef7fe640 1 -- 172.21.15.89:0/1528523295 <== osd.5 v2:172.21.15.121:6808/3864449918 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ef8009540 con 0x7f5ef40729e0 2023-08-25T09:42:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7efd3c06a120 msgr2=0x7efd3c06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7efd3b7fe640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7efd3c06a120 0x7efd3c06c5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd50000f80 tx=0x7efd50030000 comp rx=0 tx=0).stop 2023-08-25T09:42:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58142880 msgr2=0x7efd581e77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.731+0000 7efd3b7fe640 1 --2- 172.21.15.89:0/4133675096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd58142880 0x7efd581e77d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd4800b410 tx=0x7efd4800b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7efd5dc70640 1 -- 172.21.15.89:0/4133675096 reap_dead start 2023-08-25T09:42:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] conn(0x7f5ef40729e0 msgr2=0x7f5ef4074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:6808/3864449918,v1:172.21.15.121:6809/3864449918] conn(0x7f5ef40729e0 0x7f5ef4074e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 shutdown_connections 2023-08-25T09:42:05.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5ef406a120 msgr2=0x7f5ef406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5ef406a120 0x7f5ef406c5e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f00011340 tx=0x7f5f0000b040 comp rx=0 tx=0).stop 2023-08-25T09:42:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 msgr2=0x7f5f0814cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 --2- 172.21.15.89:0/1528523295 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f080711a0 0x7f5f0814cfc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009890 tx=0x7f5efc0046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f077fe640 1 -- 172.21.15.89:0/1528523295 reap_dead start 2023-08-25T09:42:05.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 >> 172.21.15.89:0/4133675096 conn(0x7efd580bbe70 msgr2=0x7efd5814af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 shutdown_connections 2023-08-25T09:42:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 >> 172.21.15.89:0/1528523295 conn(0x7f5f080bbe70 msgr2=0x7f5f080b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 shutdown_connections 2023-08-25T09:42:05.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7efd3b7fe640 1 -- 172.21.15.89:0/4133675096 wait complete. 2023-08-25T09:42:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 shutdown_connections 2023-08-25T09:42:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.732+0000 7f5f0d3cf640 1 -- 172.21.15.89:0/1528523295 wait complete. 2023-08-25T09:42:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.733+0000 7f4a83186640 1 -- 172.21.15.89:0/121478662 --> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a7c06f7b0 con 0x7f4a68072990 2023-08-25T09:42:05.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.734+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 --> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdac4149d40 con 0x7fdaa8072890 2023-08-25T09:42:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.734+0000 7f4a797fa640 1 -- 172.21.15.89:0/121478662 <== osd.1 v2:172.21.15.89:6800/2492565919 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a740099b0 con 0x7f4a68072990 2023-08-25T09:42:05.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.734+0000 7fdab9ffb640 1 -- 172.21.15.89:0/1308727860 <== osd.2 v2:172.21.15.89:6815/1353688289 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdac4149d40 con 0x7fdaa8072890 2023-08-25T09:42:05.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.735+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] conn(0x7f4a68072990 msgr2=0x7f4a68074db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.735+0000 7f4a62ffd640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6800/2492565919,v1:172.21.15.89:6801/2492565919] conn(0x7f4a68072990 0x7f4a68074db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.735+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4a6806a0d0 msgr2=0x7f4a6806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.735+0000 7f4a62ffd640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4a6806a0d0 0x7f4a6806c590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009b60 tx=0x7f4a6c009190 comp rx=0 tx=0).stop 2023-08-25T09:42:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a7c0bc960 msgr2=0x7f4a7c1ef660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.735+0000 7f592cf08640 1 -- 172.21.15.89:0/2325177142 --> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f592814ad40 con 0x7f5908072960 2023-08-25T09:42:05.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a62ffd640 1 --2- 172.21.15.89:0/121478662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a7c0bc960 0x7f4a7c1ef660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0bcd80 tx=0x7f4a7000c820 comp rx=0 tx=0).stop 2023-08-25T09:42:05.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a81723640 1 -- 172.21.15.89:0/121478662 reap_dead start 2023-08-25T09:42:05.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 shutdown_connections 2023-08-25T09:42:05.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 >> 172.21.15.89:0/121478662 conn(0x7f4a7c0bbe70 msgr2=0x7f4a7c0b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] conn(0x7fdaa8072890 msgr2=0x7fdaa8074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdaca760640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6815/1353688289,v1:172.21.15.89:6818/1353688289] conn(0x7fdaa8072890 0x7fdaa8074cb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fdaa806a050 msgr2=0x7fdaa806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdaca760640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fdaa806a050 0x7fdaa806c510 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac41e2070 tx=0x7fdab4008040 comp rx=0 tx=0).stop 2023-08-25T09:42:05.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 shutdown_connections 2023-08-25T09:42:05.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7f4a62ffd640 1 -- 172.21.15.89:0/121478662 wait complete. 2023-08-25T09:42:05.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 msgr2=0x7fdac406f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdaca760640 1 --2- 172.21.15.89:0/1308727860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab0003ad0 0x7fdac406f7e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdabc004000 tx=0x7fdabc0014a0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.736+0000 7fdac9f5f640 1 -- 172.21.15.89:0/1308727860 reap_dead start 2023-08-25T09:42:05.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.737+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 shutdown_connections 2023-08-25T09:42:05.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.737+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 >> 172.21.15.89:0/1308727860 conn(0x7fdac4069c40 msgr2=0x7fdac40b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.737+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 shutdown_connections 2023-08-25T09:42:05.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.737+0000 7fdaca760640 1 -- 172.21.15.89:0/1308727860 wait complete. 2023-08-25T09:42:05.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.738+0000 7f5924ff9640 1 -- 172.21.15.89:0/2325177142 <== osd.3 v2:172.21.15.89:6812/2349821925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5920004e40 con 0x7f5908072960 2023-08-25T09:42:05.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.740+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] conn(0x7f5908072960 msgr2=0x7f5908074d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.740+0000 7f591dffb640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6812/2349821925,v1:172.21.15.89:6814/2349821925] conn(0x7f5908072960 0x7f5908074d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.740+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f590806a0a0 msgr2=0x7f590806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.740+0000 7f591dffb640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f590806a0a0 0x7f590806c560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f591800ba00 tx=0x7f591803d040 comp rx=0 tx=0).stop 2023-08-25T09:42:05.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f592814b7a0 msgr2=0x7f592814bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:05.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f591dffb640 1 --2- 172.21.15.89:0/2325177142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f592814b7a0 0x7f592814bc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f59280613f0 tx=0x7f591000c7a0 comp rx=0 tx=0).stop 2023-08-25T09:42:05.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f5927fff640 1 -- 172.21.15.89:0/2325177142 reap_dead start 2023-08-25T09:42:05.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 shutdown_connections 2023-08-25T09:42:05.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 >> 172.21.15.89:0/2325177142 conn(0x7f5928069c40 msgr2=0x7f592813a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:05.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 shutdown_connections 2023-08-25T09:42:05.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:05.741+0000 7f591dffb640 1 -- 172.21.15.89:0/2325177142 wait complete. 2023-08-25T09:42:05.875 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2023-08-25T09:42:05.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T09:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-08-25T09:42:05.876 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-08-25T09:42:05.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T09:42:05.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T09:42:05.879 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:05.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T09:42:05.880 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:05.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T09:42:05.881 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:05.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T09:42:05.883 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-08-25T09:42:05.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T09:42:05.884 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-08-25T09:42:05.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T09:42:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f31c5742640 1 Processor -- start 2023-08-25T09:42:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f954ef99640 1 Processor -- start 2023-08-25T09:42:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f954ef99640 1 -- start start 2023-08-25T09:42:06.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f6342e57640 1 Processor -- start 2023-08-25T09:42:06.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f7e13fff640 1 Processor -- start 2023-08-25T09:42:06.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f7e13fff640 1 -- start start 2023-08-25T09:42:06.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f6342e57640 1 -- start start 2023-08-25T09:42:06.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7fb35b4d3640 1 Processor -- start 2023-08-25T09:42:06.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f954ef99640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f954813f090 0x7f95480715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6342e57640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f633c0b8b90 0x7f633c06e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6342e57640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c0b6890 0x7f633c148b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6342e57640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f633c0b6cd0 0x7f633c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f60663e3640 1 Processor -- start 2023-08-25T09:42:06.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f954ef99640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95480b5520 0x7f95480b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6342e57640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c1495b0 con 0x7f633c0b6cd0 2023-08-25T09:42:06.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6342e57640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c06ecc0 con 0x7f633c0b8b90 2023-08-25T09:42:06.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6342e57640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c152420 con 0x7f633c0b6890 2023-08-25T09:42:06.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f60663e3640 1 -- start start 2023-08-25T09:42:06.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f7e13fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e140b7b70 0x7f7e1406f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f7e13fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e14140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f7e13fff640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140b85a0 con 0x7f7e14140840 2023-08-25T09:42:06.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f7e13fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140b8380 con 0x7f7e140b7b70 2023-08-25T09:42:06.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f7e13fff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b8880 con 0x7f7e1406e430 2023-08-25T09:42:06.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.083+0000 7f31c5742640 1 -- start start 2023-08-25T09:42:06.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31c5742640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31b8007260 0x7f31b80d8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31c5742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b80398f0 0x7f31b803e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31c5742640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b803aba0 con 0x7f31b803a510 2023-08-25T09:42:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31c5742640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b803a9a0 con 0x7f31b8007260 2023-08-25T09:42:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31c5742640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b803ae80 con 0x7f31b80398f0 2023-08-25T09:42:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31bffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31b8007260 0x7f31b80d8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31bffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31b8007260 0x7f31b80d8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59546/0 (socket says 172.21.15.89:59546) 2023-08-25T09:42:06.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f31bffff640 1 -- 172.21.15.89:0/3255109236 learned_addr learned my addr 172.21.15.89:0/3255109236 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f954d536640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f954814bbd0 0x7f954814c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55816/0 (socket says 172.21.15.89:55816) 2023-08-25T09:42:06.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f954d536640 1 -- 172.21.15.89:0/775071453 learned_addr learned my addr 172.21.15.89:0/775071453 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:06.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f954cd35640 1 --2- 172.21.15.89:0/775071453 >> v2:172.21.15.121:3300/0 conn(0x7f954813f090 0x7f95480715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7f6340bf3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f633c0b8b90 0x7f633c06e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f633c0b8b90 0x7f633c06e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33170/0 (socket says 172.21.15.89:33170) 2023-08-25T09:42:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 -- 172.21.15.89:0/739227079 learned_addr learned my addr 172.21.15.89:0/739227079 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f63413f4640 1 --2- 172.21.15.89:0/739227079 >> v2:172.21.15.89:3300/0 conn(0x7f633c0b6cd0 0x7f633c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.084+0000 7fb35b4d3640 1 -- start start 2023-08-25T09:42:06.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e12ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e140b7b70 0x7f7e1406f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e12ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e140b7b70 0x7f7e1406f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59572/0 (socket says 172.21.15.89:59572) 2023-08-25T09:42:06.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e12ffd640 1 -- 172.21.15.89:0/3517005134 learned_addr learned my addr 172.21.15.89:0/3517005134 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9548071ae0 con 0x7f954814bbd0 2023-08-25T09:42:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f633bfff640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c0b6890 0x7f633c148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e127fc640 1 --2- 172.21.15.89:0/3517005134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e14140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95480b6b50 con 0x7f95480b5520 2023-08-25T09:42:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f31bffff640 1 -- 172.21.15.89:0/3255109236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b80398f0 msgr2=0x7f31b803e900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T09:42:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f31bffff640 1 --2- 172.21.15.89:0/3255109236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b80398f0 0x7f31b803e900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f31bffff640 1 -- 172.21.15.89:0/3255109236 >> v1:172.21.15.89:6789/0 conn(0x7f31b803a510 legacy=0x7f31b80cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f31bffff640 1 -- 172.21.15.89:0/3255109236 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b803e100 con 0x7f31b8007260 2023-08-25T09:42:06.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 -- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c0b6890 msgr2=0x7f633c148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954813f470 con 0x7f954813f090 2023-08-25T09:42:06.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f953f7fe640 1 -- 172.21.15.89:0/775071453 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991669009 0 0) 0x7f9548071ae0 con 0x7f954814bbd0 2023-08-25T09:42:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f953f7fe640 1 -- 172.21.15.89:0/775071453 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9530003520 con 0x7f954814bbd0 2023-08-25T09:42:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f953ffff640 1 --2- 172.21.15.89:0/775071453 >> v2:172.21.15.89:3300/0 conn(0x7f95480b5520 0x7f95480b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f954cd35640 1 -- 172.21.15.89:0/775071453 >> v2:172.21.15.89:3300/0 conn(0x7f95480b5520 msgr2=0x7f95480b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c0b6890 0x7f633c148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 -- 172.21.15.89:0/739227079 >> v2:172.21.15.89:3300/0 conn(0x7f633c0b6cd0 msgr2=0x7f633c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 --2- 172.21.15.89:0/739227079 >> v2:172.21.15.89:3300/0 conn(0x7f633c0b6cd0 0x7f633c149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f6340bf3640 1 -- 172.21.15.89:0/739227079 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c152700 con 0x7f633c0b8b90 2023-08-25T09:42:06.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb35b4d3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb3540b8b90 0x7fb35406e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb35b4d3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35406ecc0 con 0x7fb3540b6d00 2023-08-25T09:42:06.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb35b4d3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb354152420 con 0x7fb3540b6890 2023-08-25T09:42:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb35b4d3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb354152700 con 0x7fb3540b8b90 2023-08-25T09:42:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb358a6e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb3540b6890 0x7fb354148b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:49936/0 (socket says 172.21.15.89:49936) 2023-08-25T09:42:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb358a6e640 1 -- 172.21.15.89:0/899072542 learned_addr learned my addr 172.21.15.89:0/899072542 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:06.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7fb35926f640 1 --2- 172.21.15.89:0/899072542 >> v2:172.21.15.121:3300/0 conn(0x7fb3540b8b90 0x7fb35406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f60663e3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6060069ac0 0x7f6060148be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f60663e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60600ba370 0x7f6060159520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f60663e3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6060070a30 con 0x7f606006a580 2023-08-25T09:42:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f60663e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6060070ff0 con 0x7f60600ba370 2023-08-25T09:42:06.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f60663e3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600b89b0 con 0x7f6060069ac0 2023-08-25T09:42:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e127fc640 1 -- 172.21.15.89:0/3517005134 >> v2:172.21.15.89:3300/0 conn(0x7f7e140b7b70 msgr2=0x7f7e1406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e127fc640 1 --2- 172.21.15.89:0/3517005134 >> v2:172.21.15.89:3300/0 conn(0x7f7e140b7b70 0x7f7e1406f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e127fc640 1 -- 172.21.15.89:0/3517005134 >> v1:172.21.15.121:6789/0 conn(0x7f7e14140840 legacy=0x7f7e141467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.085+0000 7f7e127fc640 1 -- 172.21.15.89:0/3517005134 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140b8b60 con 0x7f7e1406e430 2023-08-25T09:42:06.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f953f7fe640 1 -- 172.21.15.89:0/775071453 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3584584265 0 0) 0x7f9530003520 con 0x7f954814bbd0 2023-08-25T09:42:06.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362969276 0 0) 0x7fb354152420 con 0x7fb3540b6890 2023-08-25T09:42:06.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb340003520 con 0x7fb3540b6890 2023-08-25T09:42:06.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f605ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6060069ac0 0x7f6060148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f605f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f606006a580 0x7f606014ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:49948/0 (socket says 172.21.15.89:49948) 2023-08-25T09:42:06.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f605f7fe640 1 -- 172.21.15.89:0/1155497079 learned_addr learned my addr 172.21.15.89:0/1155497079 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:06.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511053446 0 0) 0x7fb35406ecc0 con 0x7fb3540b6d00 2023-08-25T09:42:06.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb354152420 con 0x7fb3540b6d00 2023-08-25T09:42:06.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f954cd35640 1 --2- 172.21.15.89:0/775071453 >> v2:172.21.15.89:3300/0 conn(0x7f95480b5520 0x7f95480b98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f954cd35640 1 -- 172.21.15.89:0/775071453 >> v1:172.21.15.89:6789/0 conn(0x7f954814bbd0 legacy=0x7f954814c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f954cd35640 1 -- 172.21.15.89:0/775071453 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480b8cc0 con 0x7f954813f090 2023-08-25T09:42:06.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f6064980640 1 --2- 172.21.15.89:0/1155497079 >> v2:172.21.15.89:3300/0 conn(0x7f60600ba370 0x7f6060159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f633bfff640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c0b6890 0x7f633c148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:06.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f31bffff640 1 --2- 172.21.15.89:0/3255109236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b8007260 0x7f31b80d8c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009870 tx=0x7f31b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c931fda93d442cb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f3c4d2f9640 1 Processor -- start 2023-08-25T09:42:06.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f7c96857640 1 Processor -- start 2023-08-25T09:42:06.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f7e127fc640 1 --2- 172.21.15.89:0/3517005134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e14140300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00bfa0 tx=0x7f7e0c02e020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631c0791fdfb941c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f6064980640 1 -- 172.21.15.89:0/1155497079 >> v2:172.21.15.121:3300/0 conn(0x7f6060069ac0 msgr2=0x7f6060148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f6064980640 1 --2- 172.21.15.89:0/1155497079 >> v2:172.21.15.121:3300/0 conn(0x7f6060069ac0 0x7f6060148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f6064980640 1 -- 172.21.15.89:0/1155497079 >> v1:172.21.15.121:6789/0 conn(0x7f606006a580 legacy=0x7f606014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f31beffd640 1 -- 172.21.15.89:0/3255109236 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4031870 con 0x7f31b8007260 2023-08-25T09:42:06.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f6064980640 1 -- 172.21.15.89:0/1155497079 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600b94b0 con 0x7f60600ba370 2023-08-25T09:42:06.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f7c96857640 1 -- start start 2023-08-25T09:42:06.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f31beffd640 1 -- 172.21.15.89:0/3255109236 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40319d0 con 0x7f31b8007260 2023-08-25T09:42:06.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f31beffd640 1 -- 172.21.15.89:0/3255109236 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4031d60 con 0x7f31b8007260 2023-08-25T09:42:06.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7e11ffb640 1 -- 172.21.15.89:0/3517005134 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c02edd0 con 0x7f7e1406e430 2023-08-25T09:42:06.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7e11ffb640 1 -- 172.21.15.89:0/3517005134 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c032070 con 0x7f7e1406e430 2023-08-25T09:42:06.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7e11ffb640 1 -- 172.21.15.89:0/3517005134 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c038620 con 0x7f7e1406e430 2023-08-25T09:42:06.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb35926f640 1 -- 172.21.15.89:0/899072542 >> v1:172.21.15.121:6789/0 conn(0x7fb3540b6890 legacy=0x7fb354148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052034444 0 0) 0x7fb340003520 con 0x7fb3540b6890 2023-08-25T09:42:06.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb35926f640 1 -- 172.21.15.89:0/899072542 >> v1:172.21.15.89:6789/0 conn(0x7fb3540b6d00 legacy=0x7fb354159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7fb35926f640 1 -- 172.21.15.89:0/899072542 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3541529e0 con 0x7fb3540b8b90 2023-08-25T09:42:06.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f3c4d2f9640 1 -- start start 2023-08-25T09:42:06.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f954cd35640 1 --2- 172.21.15.89:0/775071453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f95480715a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f954806af40 tx=0x7f954402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cbc1b03d0339cc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f953f7fe640 1 -- 172.21.15.89:0/775071453 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400019f0 con 0x7f954813f090 2023-08-25T09:42:06.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.086+0000 7f6340bf3640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b8b90 0x7f633c06e780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f633c0b9390 tx=0x7f633002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4381fe9188d95667 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f633b7fe640 1 -- 172.21.15.89:0/739227079 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633002d040 con 0x7f633c0b8b90 2023-08-25T09:42:06.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f633b7fe640 1 -- 172.21.15.89:0/739227079 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330031810 con 0x7f633c0b8b90 2023-08-25T09:42:06.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f633b7fe640 1 -- 172.21.15.89:0/739227079 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330031be0 con 0x7f633c0b8b90 2023-08-25T09:42:06.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f953f7fe640 1 -- 172.21.15.89:0/775071453 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544033440 con 0x7f954813f090 2023-08-25T09:42:06.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 -- 172.21.15.89:0/3255109236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b8007260 msgr2=0x7f31b80d8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 --2- 172.21.15.89:0/3255109236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b8007260 0x7f31b80d8c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009870 tx=0x7f31b402b910 comp rx=0 tx=0).stop 2023-08-25T09:42:06.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 -- 172.21.15.89:0/3255109236 shutdown_connections 2023-08-25T09:42:06.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 --2- 172.21.15.89:0/3255109236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b80398f0 0x7f31b803e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 --2- 172.21.15.89:0/3255109236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b8007260 0x7f31b80d8c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 -- 172.21.15.89:0/3255109236 >> 172.21.15.89:0/3255109236 conn(0x7f31b803ef70 msgr2=0x7f31b803f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 -- 172.21.15.89:0/3255109236 shutdown_connections 2023-08-25T09:42:06.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f31c5742640 1 -- 172.21.15.89:0/3255109236 wait complete. 2023-08-25T09:42:06.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c4d2f9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 0x7f3c480654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c4d2f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c48146f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c4d2f9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480700f0 con 0x7f3c4806ed40 2023-08-25T09:42:06.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c4d2f9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48070d90 con 0x7f3c4806aad0 2023-08-25T09:42:06.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c4d2f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48146b30 con 0x7f3c48141000 2023-08-25T09:42:06.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c47fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 0x7f3c480654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f953f7fe640 1 -- 172.21.15.89:0/775071453 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440337d0 con 0x7f954813f090 2023-08-25T09:42:06.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 msgr2=0x7f95480715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f954ef99640 1 --2- 172.21.15.89:0/775071453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f95480715a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f954806af40 tx=0x7f954402b7a0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 -- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b8b90 msgr2=0x7f633c06e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b8b90 0x7f633c06e780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f633c0b9390 tx=0x7f633002b8b0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 -- 172.21.15.89:0/739227079 shutdown_connections 2023-08-25T09:42:06.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 --2- 172.21.15.89:0/739227079 >> v2:172.21.15.89:3300/0 conn(0x7f633c0b6cd0 0x7f633c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c0b6890 0x7f633c148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 --2- 172.21.15.89:0/739227079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b8b90 0x7f633c06e780 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f633c0b9390 tx=0x7f633002b8b0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 -- 172.21.15.89:0/739227079 >> 172.21.15.89:0/739227079 conn(0x7f633c069a30 msgr2=0x7f633c069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 -- 172.21.15.89:0/739227079 shutdown_connections 2023-08-25T09:42:06.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7fb35926f640 1 --2- 172.21.15.89:0/899072542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b8b90 0x7fb35406e780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb350009720 tx=0x7fb35002b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ccafb8f1169404c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344001670 con 0x7fb3540b8b90 2023-08-25T09:42:06.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350031520 con 0x7fb3540b8b90 2023-08-25T09:42:06.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7fb34bfff640 1 -- 172.21.15.89:0/899072542 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500316b0 con 0x7fb3540b8b90 2023-08-25T09:42:06.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7c96857640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c900b8b90 0x7f7c9006e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7c96857640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c90148b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7c96857640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9006ecc0 con 0x7f7c900b6cd0 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7c96857640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c90152420 con 0x7f7c900b8b90 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7c96857640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c90152700 con 0x7f7c900b6890 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.087+0000 7f7c94df4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7c900b6cd0 0x7f7c9014ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55838/0 (socket says 172.21.15.89:55838) 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c94df4640 1 -- 172.21.15.89:0/1621862237 learned_addr learned my addr 172.21.15.89:0/1621862237 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c8ffff640 1 --2- 172.21.15.89:0/1621862237 >> v2:172.21.15.89:3300/0 conn(0x7f7c900b8b90 0x7f7c9006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c8f7fe640 1 --2- 172.21.15.89:0/1621862237 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c90148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c8ffff640 1 -- 172.21.15.89:0/1621862237 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 msgr2=0x7f7c90148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c8ffff640 1 --2- 172.21.15.89:0/1621862237 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c90148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c8ffff640 1 -- 172.21.15.89:0/1621862237 >> v1:172.21.15.89:6789/0 conn(0x7f7c900b6cd0 legacy=0x7f7c9014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7c8ffff640 1 -- 172.21.15.89:0/1621862237 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c901529e0 con 0x7f7c900b8b90 2023-08-25T09:42:06.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6064980640 1 --2- 172.21.15.89:0/1155497079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f6060159520 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f606006e680 tx=0x7f605802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80312823b5c213cc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f605effd640 1 -- 172.21.15.89:0/1155497079 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605802cc70 con 0x7f60600ba370 2023-08-25T09:42:06.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f605effd640 1 -- 172.21.15.89:0/1155497079 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605802cdd0 con 0x7f60600ba370 2023-08-25T09:42:06.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f605effd640 1 -- 172.21.15.89:0/1155497079 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058034660 con 0x7f60600ba370 2023-08-25T09:42:06.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7e13fff640 1 -- 172.21.15.89:0/3517005134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 msgr2=0x7f7e14140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f7e13fff640 1 --2- 172.21.15.89:0/3517005134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e14140300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00bfa0 tx=0x7f7e0c02e020 comp rx=0 tx=0).stop 2023-08-25T09:42:06.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c47fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 0x7f3c480654f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33190/0 (socket says 172.21.15.89:33190) 2023-08-25T09:42:06.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c47fff640 1 -- 172.21.15.89:0/1807825326 learned_addr learned my addr 172.21.15.89:0/1807825326 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1807825326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c48146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 -- 172.21.15.89:0/899072542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b8b90 msgr2=0x7fb35406e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 --2- 172.21.15.89:0/899072542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b8b90 0x7fb35406e780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb350009720 tx=0x7fb35002b7c0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 -- 172.21.15.89:0/899072542 shutdown_connections 2023-08-25T09:42:06.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 --2- 172.21.15.89:0/899072542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b8b90 0x7fb35406e780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 -- 172.21.15.89:0/899072542 >> 172.21.15.89:0/899072542 conn(0x7fb354069a30 msgr2=0x7fb354069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 -- 172.21.15.89:0/1155497079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 msgr2=0x7f6060159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 --2- 172.21.15.89:0/1155497079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f6060159520 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f606006e680 tx=0x7f605802bec0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f7e13fff640 1 -- 172.21.15.89:0/3517005134 shutdown_connections 2023-08-25T09:42:06.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f7e13fff640 1 --2- 172.21.15.89:0/3517005134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e14140300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f7e13fff640 1 --2- 172.21.15.89:0/3517005134 >> v2:172.21.15.89:3300/0 conn(0x7f7e140b7b70 0x7f7e1406f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f7e13fff640 1 -- 172.21.15.89:0/3517005134 >> 172.21.15.89:0/3517005134 conn(0x7f7e14071930 msgr2=0x7f7e14069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 shutdown_connections 2023-08-25T09:42:06.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f954ef99640 1 --2- 172.21.15.89:0/775071453 >> v2:172.21.15.89:3300/0 conn(0x7f95480b5520 0x7f95480b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f954ef99640 1 --2- 172.21.15.89:0/775071453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f95480715a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 >> 172.21.15.89:0/775071453 conn(0x7f95480bcd40 msgr2=0x7f95480b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f3c4caf8640 1 -- 172.21.15.89:0/1807825326 >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 msgr2=0x7f3c480654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:06.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1807825326 >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 0x7f3c480654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f3c4caf8640 1 -- 172.21.15.89:0/1807825326 >> v1:172.21.15.121:6789/0 conn(0x7f3c4806ed40 legacy=0x7f3c481408f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T09:42:06.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f3c4caf8640 1 -- 172.21.15.89:0/1807825326 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480703d0 con 0x7f3c48141000 2023-08-25T09:42:06.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f3c47fff640 1 --2- 172.21.15.89:0/1807825326 >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 0x7f3c480654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:06.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 -- 172.21.15.89:0/899072542 shutdown_connections 2023-08-25T09:42:06.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.088+0000 7f6342e57640 1 -- 172.21.15.89:0/739227079 wait complete. 2023-08-25T09:42:06.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f7e13fff640 1 -- 172.21.15.89:0/3517005134 shutdown_connections 2023-08-25T09:42:06.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 -- 172.21.15.89:0/1155497079 shutdown_connections 2023-08-25T09:42:06.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 --2- 172.21.15.89:0/1155497079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f6060159520 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 --2- 172.21.15.89:0/1155497079 >> v2:172.21.15.121:3300/0 conn(0x7f6060069ac0 0x7f6060148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 -- 172.21.15.89:0/1155497079 >> 172.21.15.89:0/1155497079 conn(0x7f60600b9850 msgr2=0x7f60600b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 -- 172.21.15.89:0/1155497079 shutdown_connections 2023-08-25T09:42:06.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7fb35b4d3640 1 -- 172.21.15.89:0/899072542 wait complete. 2023-08-25T09:42:06.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f31c5742640 1 Processor -- start 2023-08-25T09:42:06.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 -- start start 2023-08-25T09:42:06.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 shutdown_connections 2023-08-25T09:42:06.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f6342e57640 1 Processor -- start 2023-08-25T09:42:06.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f7c8ffff640 1 --2- 172.21.15.89:0/1621862237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b8b90 0x7f7c9006e780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c840097a0 tx=0x7f7c8402b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8b726187dbada server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f7c8effd640 1 -- 172.21.15.89:0/1621862237 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84030710 con 0x7f7c900b8b90 2023-08-25T09:42:06.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8007260 0x7f31b80363a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b80398f0 0x7f31b80c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 0x7f31b80c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8036e60 con 0x7f31b80398f0 2023-08-25T09:42:06.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80ba8a0 con 0x7f31b8007260 2023-08-25T09:42:06.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f31c5742640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8037b30 con 0x7f31b803a510 2023-08-25T09:42:06.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f6342e57640 1 -- start start 2023-08-25T09:42:06.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f954ef99640 1 -- 172.21.15.89:0/775071453 wait complete. 2023-08-25T09:42:06.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f7e13fff640 1 -- 172.21.15.89:0/3517005134 wait complete. 2023-08-25T09:42:06.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7fb35b4d3640 1 Processor -- start 2023-08-25T09:42:06.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f7e13fff640 1 Processor -- start 2023-08-25T09:42:06.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.090+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1807825326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c48146f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009d90 tx=0x7f3c4002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b763d7e39a589b90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f7c8effd640 1 -- 172.21.15.89:0/1621862237 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8402e050 con 0x7f7c900b8b90 2023-08-25T09:42:06.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 0x7f31b80c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 0x7f31b80c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49290/0 (socket says 172.21.15.89:49290) 2023-08-25T09:42:06.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 -- 172.21.15.89:0/3251669326 learned_addr learned my addr 172.21.15.89:0/3251669326 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.089+0000 7f60663e3640 1 -- 172.21.15.89:0/1155497079 wait complete. 2023-08-25T09:42:06.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f60663e3640 1 Processor -- start 2023-08-25T09:42:06.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f3c46ffd640 1 -- 172.21.15.89:0/1807825326 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4002cbc0 con 0x7f3c48141000 2023-08-25T09:42:06.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f3c46ffd640 1 -- 172.21.15.89:0/1807825326 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4002cd20 con 0x7f3c48141000 2023-08-25T09:42:06.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f3c46ffd640 1 -- 172.21.15.89:0/1807825326 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40034660 con 0x7f3c48141000 2023-08-25T09:42:06.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6342e57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f633c0b6890 0x7f633c14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6342e57640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b6cd0 0x7f633c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6342e57640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c14ded0 0x7f633c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6342e57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c14a790 con 0x7f633c0b6890 2023-08-25T09:42:06.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6342e57640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c14da40 con 0x7f633c0b6cd0 2023-08-25T09:42:06.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6342e57640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c14d760 con 0x7f633c14ded0 2023-08-25T09:42:06.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6340bf3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f633c0b6890 0x7f633c14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6340bf3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f633c0b6890 0x7f633c14ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59608/0 (socket says 172.21.15.89:59608) 2023-08-25T09:42:06.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f6340bf3640 1 -- 172.21.15.89:0/3536980869 learned_addr learned my addr 172.21.15.89:0/3536980869 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f63413f4640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c14ded0 0x7f633c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 -- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8007260 msgr2=0x7f31b80363a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8007260 0x7f31b80363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 -- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b80398f0 msgr2=0x7f31b80c0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b80398f0 0x7f31b80c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 -- 172.21.15.89:0/3251669326 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40094d0 con 0x7f31b803a510 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f31c4f41640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 0x7f31b80c0ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31c00638b0 tx=0x7f31c006bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0066d50 con 0x7f31b803a510 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0092470 con 0x7f31b803a510 2023-08-25T09:42:06.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0092820 con 0x7f31b803a510 2023-08-25T09:42:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f31c5742640 1 -- 172.21.15.89:0/3251669326 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b80368e0 con 0x7f31b803a510 2023-08-25T09:42:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f31c5742640 1 -- 172.21.15.89:0/3251669326 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b80ba250 con 0x7f31b803a510 2023-08-25T09:42:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1807825326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 msgr2=0x7f3c48146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1807825326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c48146f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009d90 tx=0x7f3c4002be10 comp rx=0 tx=0).stop 2023-08-25T09:42:06.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f954ef99640 1 Processor -- start 2023-08-25T09:42:06.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 -- 172.21.15.89:0/1621862237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b8b90 msgr2=0x7f7c9006e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 --2- 172.21.15.89:0/1621862237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b8b90 0x7f7c9006e780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c840097a0 tx=0x7f7c8402b660 comp rx=0 tx=0).stop 2023-08-25T09:42:06.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f60663e3640 1 -- start start 2023-08-25T09:42:06.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7f7e13fff640 1 -- start start 2023-08-25T09:42:06.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7e13fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e141db390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 -- 172.21.15.89:0/1621862237 shutdown_connections 2023-08-25T09:42:06.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 --2- 172.21.15.89:0/1621862237 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c90148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 --2- 172.21.15.89:0/1621862237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b8b90 0x7f7c9006e780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 -- 172.21.15.89:0/1621862237 >> 172.21.15.89:0/1621862237 conn(0x7f7c90069a30 msgr2=0x7f7c90069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f954ef99640 1 -- start start 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.091+0000 7fb35b4d3640 1 -- start start 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35b4d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b6890 0x7fb3540b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35b4d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3540b6d00 0x7fb35414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35b4d3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3540b8b90 0x7fb3540b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35b4d3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541e6dc0 con 0x7fb3540b6d00 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35b4d3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354147500 con 0x7fb3540b6890 2023-08-25T09:42:06.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35b4d3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540b3840 con 0x7fb3540b8b90 2023-08-25T09:42:06.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35926f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b6890 0x7fb3540b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35926f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b6890 0x7fb3540b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33224/0 (socket says 172.21.15.89:33224) 2023-08-25T09:42:06.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb35926f640 1 -- 172.21.15.89:0/469363311 learned_addr learned my addr 172.21.15.89:0/469363311 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb358a6e640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3540b6d00 0x7fb35414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.169 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7fb359a70640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3540b8b90 0x7fb3540b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1807825326 shutdown_connections 2023-08-25T09:42:06.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1807825326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c48146f60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1807825326 >> v2:172.21.15.121:3300/0 conn(0x7f3c4806aad0 0x7f3c480654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1807825326 >> 172.21.15.89:0/1807825326 conn(0x7f3c480b8f80 msgr2=0x7f3c480b9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1807825326 shutdown_connections 2023-08-25T09:42:06.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f63413f4640 1 -- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b6cd0 msgr2=0x7f633c0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f63413f4640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b6cd0 0x7f633c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f63413f4640 1 -- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f633c0b6890 msgr2=0x7f633c14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f63413f4640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f633c0b6890 0x7f633c14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f63413f4640 1 -- 172.21.15.89:0/3536980869 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300094d0 con 0x7f633c14ded0 2023-08-25T09:42:06.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7fb358a6e640 1 -- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3540b8b90 msgr2=0x7fb3540b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7fb358a6e640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3540b8b90 0x7fb3540b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7fb358a6e640 1 -- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b6890 msgr2=0x7fb3540b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7fb358a6e640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b6890 0x7fb3540b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7fb358a6e640 1 -- 172.21.15.89:0/469363311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350009400 con 0x7fb3540b6d00 2023-08-25T09:42:06.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f7c96857640 1 -- 172.21.15.89:0/1621862237 shutdown_connections 2023-08-25T09:42:06.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f63413f4640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c14ded0 0x7f633c14e350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f633400ebd0 tx=0x7f633400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.173 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f60663e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6060069ac0 0x7f60601529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f60663e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606006a580 0x7f60601ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f60663e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f60601ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f60663e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060152080 con 0x7f60600ba370 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f60663e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060152f30 con 0x7f606006a580 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f60663e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60601505e0 con 0x7f6060069ac0 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f605ffff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6060069ac0 0x7f60601529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.174 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f605f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606006a580 0x7f60601ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f605ffff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6060069ac0 0x7f60601529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49312/0 (socket says 172.21.15.89:49312) 2023-08-25T09:42:06.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f605ffff640 1 -- 172.21.15.89:0/1874252576 learned_addr learned my addr 172.21.15.89:0/1874252576 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400cd20 con 0x7f633c14ded0 2023-08-25T09:42:06.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400f040 con 0x7f633c14ded0 2023-08-25T09:42:06.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340146c0 con 0x7f633c14ded0 2023-08-25T09:42:06.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7fb358a6e640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3540b6d00 0x7fb35414c090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb34400c750 tx=0x7fb34400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f6064980640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f60601ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e13fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140b7b70 0x7f7e141df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e13fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 0x7f7e14141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e13fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14141750 con 0x7f7e140b7b70 2023-08-25T09:42:06.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e13fff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141de8e0 con 0x7f7e14140840 2023-08-25T09:42:06.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e13fff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14146f80 con 0x7f7e1406e430 2023-08-25T09:42:06.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 0x7f7e14141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 0x7f7e14141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33248/0 (socket says 172.21.15.89:33248) 2023-08-25T09:42:06.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e137fe640 1 -- 172.21.15.89:0/1463124050 learned_addr learned my addr 172.21.15.89:0/1463124050 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e127fc640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140b7b70 0x7f7e141df330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7e12ffd640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e141db390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f31c5742640 1 -- 172.21.15.89:0/3251669326 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a0005250 con 0x7f31b803a510 2023-08-25T09:42:06.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.092+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1807825326 wait complete. 2023-08-25T09:42:06.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f7c96857640 1 -- 172.21.15.89:0/1621862237 wait complete. 2023-08-25T09:42:06.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e137fe640 1 -- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 msgr2=0x7f7e141db390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e137fe640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e141db390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e137fe640 1 -- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140b7b70 msgr2=0x7f7e141df330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e137fe640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140b7b70 0x7f7e141df330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e137fe640 1 -- 172.21.15.89:0/1463124050 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c00bc80 con 0x7f7e14140840 2023-08-25T09:42:06.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e137fe640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 0x7f7e14141210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c3c0 tx=0x7f7e0800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f3c4d2f9640 1 Processor -- start 2023-08-25T09:42:06.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c14f3b0 con 0x7f633c14ded0 2023-08-25T09:42:06.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.093+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c14f8e0 con 0x7f633c14ded0 2023-08-25T09:42:06.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f605f7fe640 1 -- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6060069ac0 msgr2=0x7f60601529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f605f7fe640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6060069ac0 0x7f60601529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f605f7fe640 1 -- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 msgr2=0x7f60601ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f605f7fe640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f60601ed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f605f7fe640 1 -- 172.21.15.89:0/1874252576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058009a70 con 0x7f606006a580 2023-08-25T09:42:06.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31c008f070 con 0x7f31b803a510 2023-08-25T09:42:06.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c066080 con 0x7f633c14ded0 2023-08-25T09:42:06.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080052d0 con 0x7f7e14140840 2023-08-25T09:42:06.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e141deb30 con 0x7f7e14140840 2023-08-25T09:42:06.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e140b2930 con 0x7f7e14140840 2023-08-25T09:42:06.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08005430 con 0x7f7e14140840 2023-08-25T09:42:06.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f31bcff9640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f31a406a150 0x7f31a406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31c01015d0 con 0x7f31b803a510 2023-08-25T09:42:06.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f954ef99640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 0x7f9548070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f954ef99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f9548141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f954ef99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f954814bbd0 0x7f95481e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f954ef99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548070b40 con 0x7f954814bbd0 2023-08-25T09:42:06.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f954ef99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548141f60 con 0x7f954813f090 2023-08-25T09:42:06.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f954ef99640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95481e2ef0 con 0x7f95480b5520 2023-08-25T09:42:06.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f605f7fe640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606006a580 0x7f60601ecbb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f605400c440 tx=0x7f6054001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f31bffff640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f31a406a150 0x7f31a406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f7c96857640 1 Processor -- start 2023-08-25T09:42:06.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f7c96857640 1 -- start start 2023-08-25T09:42:06.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.094+0000 7f3c4d2f9640 1 -- start start 2023-08-25T09:42:06.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f3c4d2f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c4806aad0 0x7f3c481353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054005ce0 con 0x7f606006a580 2023-08-25T09:42:06.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08007240 con 0x7f7e14140840 2023-08-25T09:42:06.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f954cd35640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 0x7f9548070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f954cd35640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 0x7f9548070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49334/0 (socket says 172.21.15.89:49334) 2023-08-25T09:42:06.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f954cd35640 1 -- 172.21.15.89:0/3653775044 learned_addr learned my addr 172.21.15.89:0/3653775044 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c96857640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c901408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c96857640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b6cd0 0x7f7c90146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c96857640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 0x7f7c901511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c96857640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c90146d50 con 0x7f7c900b6cd0 2023-08-25T09:42:06.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c96857640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900b6610 con 0x7f7c901f0280 2023-08-25T09:42:06.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c96857640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c901efdf0 con 0x7f7c900b6890 2023-08-25T09:42:06.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60601507f0 con 0x7f606006a580 2023-08-25T09:42:06.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6060150db0 con 0x7f606006a580 2023-08-25T09:42:06.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054005e40 con 0x7f606006a580 2023-08-25T09:42:06.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f953ffff640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f9548141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 0x7f7c901511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 0x7f7c901511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33272/0 (socket says 172.21.15.89:33272) 2023-08-25T09:42:06.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 -- 172.21.15.89:0/3458974265 learned_addr learned my addr 172.21.15.89:0/3458974265 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c8ffff640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c901408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f3c4d2f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c4806ed40 0x7f3c481eede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440072d0 con 0x7fb3540b6d00 2023-08-25T09:42:06.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344007450 con 0x7fb3540b6d00 2023-08-25T09:42:06.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.095+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440047e0 con 0x7fb3540b6d00 2023-08-25T09:42:06.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 -- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 msgr2=0x7f7c901408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c901408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 -- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b6cd0 msgr2=0x7f7c90146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b6cd0 0x7f7c90146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7c94df4640 1 -- 172.21.15.89:0/3458974265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84009400 con 0x7f7c901f0280 2023-08-25T09:42:06.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f31bffff640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f31a406a150 0x7f31a406c610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31b4036000 tx=0x7f31b4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df4005250 con 0x7f7e14140840 2023-08-25T09:42:06.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540072d0 con 0x7f606006a580 2023-08-25T09:42:06.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f3c477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c4806ed40 0x7f3c481eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f3c477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c4806ed40 0x7f3c481eede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33284/0 (socket says 172.21.15.89:33284) 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.096+0000 7f3c4d2f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c481ef320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c477fe640 1 -- 172.21.15.89:0/1710115551 learned_addr learned my addr 172.21.15.89:0/1710115551 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c47fff640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c4806aad0 0x7f3c481353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48135900 con 0x7f3c4806aad0 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481ecd20 con 0x7f3c4806ed40 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481ed000 con 0x7f3c48141000 2023-08-25T09:42:06.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c481ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954d536640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f954814bbd0 0x7f95481e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954cd35640 1 -- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 msgr2=0x7f9548141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954cd35640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f9548141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954cd35640 1 -- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f954814bbd0 msgr2=0x7f95481e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954cd35640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f954814bbd0 0x7f95481e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954cd35640 1 -- 172.21.15.89:0/3653775044 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009400 con 0x7f95480b5520 2023-08-25T09:42:06.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7fb35b4d3640 1 -- 172.21.15.89:0/469363311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3541e6fd0 con 0x7fb3540b6d00 2023-08-25T09:42:06.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e080073a0 con 0x7f7e14140840 2023-08-25T09:42:06.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7fb35b4d3640 1 -- 172.21.15.89:0/469363311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3541e7590 con 0x7fb3540b6d00 2023-08-25T09:42:06.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f7dfbfff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7e0006a120 0x7f7e0006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4caf8640 1 -- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c4806ed40 msgr2=0x7f3c481eede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c4806ed40 0x7f3c481eede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4caf8640 1 -- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c4806aad0 msgr2=0x7f3c481353c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c4806aad0 0x7f3c481353c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c4caf8640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c380094d0 con 0x7f3c48141000 2023-08-25T09:42:06.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f3c47fff640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c4806aad0 0x7f3c481353c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:06.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f954cd35640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 0x7f9548070600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f954402bdb0 tx=0x7f95440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f7c94df4640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 0x7f7c901511b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c8c0 tx=0x7f7c8800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6040005250 con 0x7f606006a580 2023-08-25T09:42:06.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e080876f0 con 0x7f7e14140840 2023-08-25T09:42:06.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.097+0000 7f7e12ffd640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7e0006a120 0x7f7e0006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.098+0000 7f3c4caf8640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c481ef320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3c40033000 tx=0x7f3c40004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.098+0000 7f7e12ffd640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7e0006a120 0x7f7e0006c5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e040094d0 tx=0x7f7e0400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.098+0000 7fb35b4d3640 1 -- 172.21.15.89:0/469363311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35414c630 con 0x7fb3540b6d00 2023-08-25T09:42:06.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.098+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60540074f0 con 0x7f606006a580 2023-08-25T09:42:06.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7f605cff9640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f604c06a0a0 0x7f604c06c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60540879c0 con 0x7f606006a580 2023-08-25T09:42:06.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb344004960 con 0x7fb3540b6d00 2023-08-25T09:42:06.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7f605ffff640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f604c06a0a0 0x7f604c06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7fb349ffb640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb33806a0a0 0x7fb33806c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb344087cb0 con 0x7fb3540b6d00 2023-08-25T09:42:06.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7f605ffff640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f604c06a0a0 0x7f604c06c560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6050007af0 tx=0x7f6050008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.099+0000 7fb35926f640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb33806a0a0 0x7fb33806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7fb35926f640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb33806a0a0 0x7fb33806c560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb35002b800 tx=0x7fb350030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31c00d0730 con 0x7f31b803a510 2023-08-25T09:42:06.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4003e610 con 0x7f3c48141000 2023-08-25T09:42:06.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544030a80 con 0x7f95480b5520 2023-08-25T09:42:06.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544030be0 con 0x7f95480b5520 2023-08-25T09:42:06.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954403d410 con 0x7f95480b5520 2023-08-25T09:42:06.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9548142430 con 0x7f95480b5520 2023-08-25T09:42:06.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4002ce90 con 0x7f3c48141000 2023-08-25T09:42:06.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.100+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4003e9d0 con 0x7f3c48141000 2023-08-25T09:42:06.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.101+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c40009a70 con 0x7f3c48141000 2023-08-25T09:42:06.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.101+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c481ed8d0 con 0x7f3c48141000 2023-08-25T09:42:06.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.101+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95481e3190 con 0x7f95480b5520 2023-08-25T09:42:06.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.102+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c48140dd0 con 0x7f3c48141000 2023-08-25T09:42:06.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.102+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800a5e0 con 0x7f7c901f0280 2023-08-25T09:42:06.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.102+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c90147c50 con 0x7f7c901f0280 2023-08-25T09:42:06.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.102+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c901efa80 con 0x7f7c901f0280 2023-08-25T09:42:06.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.102+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e08052f00 con 0x7f7e14140840 2023-08-25T09:42:06.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.102+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95481e2d50 con 0x7f95480b5520 2023-08-25T09:42:06.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.103+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6334014820 con 0x7f633c14ded0 2023-08-25T09:42:06.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.103+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c90147ab0 con 0x7f7c901f0280 2023-08-25T09:42:06.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.103+0000 7f63397fa640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f632006a120 0x7f632006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.103+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63340897b0 con 0x7f633c14ded0 2023-08-25T09:42:06.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.103+0000 7f6340bf3640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f632006a120 0x7f632006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.104+0000 7f6340bf3640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f632006a120 0x7f632006c5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6330000c00 tx=0x7f633003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.105+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb3440534f0 con 0x7fb3540b6d00 2023-08-25T09:42:06.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.105+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f63340589a0 con 0x7f633c14ded0 2023-08-25T09:42:06.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800a740 con 0x7f7c901f0280 2023-08-25T09:42:06.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800aab0 con 0x7f7c901f0280 2023-08-25T09:42:06.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f60540531b0 con 0x7f606006a580 2023-08-25T09:42:06.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.106+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f954403a050 con 0x7f95480b5520 2023-08-25T09:42:06.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c4003b050 con 0x7f3c48141000 2023-08-25T09:42:06.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f3c44ff9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3c3406a050 0x7f3c3406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c400ab040 con 0x7f3c48141000 2023-08-25T09:42:06.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f953d7fa640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f953406a150 0x7f953406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.107+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95440aa560 con 0x7f95480b5520 2023-08-25T09:42:06.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.108+0000 7f953ffff640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f953406a150 0x7f953406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.108+0000 7f3c47fff640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3c3406a050 0x7f3c3406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.108+0000 7f953ffff640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f953406a150 0x7f953406c610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95481dd410 tx=0x7f9538008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.108+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c8800ac10 con 0x7f7c901f0280 2023-08-25T09:42:06.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.109+0000 7f3c47fff640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3c3406a050 0x7f3c3406c510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c38006ca0 tx=0x7f3c38009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.109+0000 7f7c8cff9640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7c7c06a080 0x7f7c7c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:06.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.109+0000 7f7c8ffff640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7c7c06a080 0x7f7c7c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:06.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.109+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c88088180 con 0x7f7c901f0280 2023-08-25T09:42:06.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.109+0000 7f7c8ffff640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7c7c06a080 0x7f7c7c06c540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034000 tx=0x7f7c84008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:06.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.110+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9544075c50 con 0x7f95480b5520 2023-08-25T09:42:06.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.111+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7c88053920 con 0x7f7c901f0280 2023-08-25T09:42:06.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.114+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c40076850 con 0x7f3c48141000 2023-08-25T09:42:06.334 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T09:42:06.332+0000 7fa1dbddc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T09:42:06.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.483+0000 7fb35b4d3640 1 -- 172.21.15.89:0/469363311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb354152c90 con 0x7fb3540b6d00 2023-08-25T09:42:06.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.483+0000 7fb349ffb640 1 -- 172.21.15.89:0/469363311 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb344018020 con 0x7fb3540b6d00 2023-08-25T09:42:06.486 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-08-25T09:42:06.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.486+0000 7fb3377fe640 1 -- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb33806a0a0 msgr2=0x7fb33806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.486+0000 7fb3377fe640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb33806a0a0 0x7fb33806c560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb35002b800 tx=0x7fb350030000 comp rx=0 tx=0).stop 2023-08-25T09:42:06.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.486+0000 7fb3377fe640 1 -- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3540b6d00 msgr2=0x7fb35414c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.486+0000 7fb3377fe640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3540b6d00 0x7fb35414c090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb34400c750 tx=0x7fb34400cc10 comp rx=0 tx=0).stop 2023-08-25T09:42:06.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 -- 172.21.15.89:0/469363311 shutdown_connections 2023-08-25T09:42:06.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb33806a0a0 0x7fb33806c560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3540b6d00 0x7fb35414c090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3540b8b90 0x7fb3540b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 --2- 172.21.15.89:0/469363311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3540b6890 0x7fb3540b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 -- 172.21.15.89:0/469363311 >> 172.21.15.89:0/469363311 conn(0x7fb354069a30 msgr2=0x7fb354069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 -- 172.21.15.89:0/469363311 shutdown_connections 2023-08-25T09:42:06.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.491+0000 7fb3377fe640 1 -- 172.21.15.89:0/469363311 wait complete. 2023-08-25T09:42:06.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.495+0000 7f31c5742640 1 -- 172.21.15.89:0/3251669326 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f31a0005500 con 0x7f31b803a510 2023-08-25T09:42:06.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.495+0000 7f31bcff9640 1 -- 172.21.15.89:0/3251669326 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31c00d02c0 con 0x7f31b803a510 2023-08-25T09:42:06.501 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:06.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.500+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7df4005500 con 0x7f7e14140840 2023-08-25T09:42:06.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 -- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f31a406a150 msgr2=0x7f31a406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f31a406a150 0x7f31a406c610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31b4036000 tx=0x7f31b4030000 comp rx=0 tx=0).stop 2023-08-25T09:42:06.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 -- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 msgr2=0x7f31b80c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 0x7f31b80c0ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31c00638b0 tx=0x7f31c006bdb0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 -- 172.21.15.89:0/3251669326 shutdown_connections 2023-08-25T09:42:06.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f31a406a150 0x7f31a406c610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f7dfbfff640 1 -- 172.21.15.89:0/1463124050 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e08056520 con 0x7f7e14140840 2023-08-25T09:42:06.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31b80398f0 0x7f31b80c0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.505 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:06.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31b803a510 0x7f31b80c0ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 --2- 172.21.15.89:0/3251669326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b8007260 0x7f31b80363a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.501+0000 7f31aa7fc640 1 -- 172.21.15.89:0/3251669326 >> 172.21.15.89:0/3251669326 conn(0x7f31b803ef70 msgr2=0x7f31b80056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.502+0000 7f31aa7fc640 1 -- 172.21.15.89:0/3251669326 shutdown_connections 2023-08-25T09:42:06.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.502+0000 7f31aa7fc640 1 -- 172.21.15.89:0/3251669326 wait complete. 2023-08-25T09:42:06.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.504+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7e0006a120 msgr2=0x7f7e0006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.504+0000 7f7e13fff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7e0006a120 0x7f7e0006c5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e040094d0 tx=0x7f7e0400b040 comp rx=0 tx=0).stop 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 msgr2=0x7f7e14141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 0x7f7e14141210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c3c0 tx=0x7f7e0800c880 comp rx=0 tx=0).stop 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 shutdown_connections 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7e0006a120 0x7f7e0006c5e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140b7b70 0x7f7e141df330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e14140840 0x7f7e14141210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 --2- 172.21.15.89:0/1463124050 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7e1406e430 0x7f7e141db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.505+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 >> 172.21.15.89:0/1463124050 conn(0x7f7e14071930 msgr2=0x7f7e1413cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-08-25T09:42:06.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.507+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 shutdown_connections 2023-08-25T09:42:06.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.507+0000 7f7e13fff640 1 -- 172.21.15.89:0/1463124050 wait complete. 2023-08-25T09:42:06.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.509+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f633c1529c0 con 0x7f633c14ded0 2023-08-25T09:42:06.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.510+0000 7f63397fa640 1 -- 172.21.15.89:0/3536980869 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f633c1529c0 con 0x7f633c14ded0 2023-08-25T09:42:06.512 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-08-25T09:42:06.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.513+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f632006a120 msgr2=0x7f632006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.513+0000 7f6342e57640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f632006a120 0x7f632006c5e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6330000c00 tx=0x7f633003c040 comp rx=0 tx=0).stop 2023-08-25T09:42:06.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.513+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c14ded0 msgr2=0x7f633c14e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.513+0000 7f6342e57640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c14ded0 0x7f633c14e350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f633400ebd0 tx=0x7f633400c490 comp rx=0 tx=0).stop 2023-08-25T09:42:06.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95481e2d50 con 0x7f95480b5520 2023-08-25T09:42:06.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 shutdown_connections 2023-08-25T09:42:06.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f632006a120 0x7f632006c5e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f633c14ded0 0x7f633c14e350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f633c0b6cd0 0x7f633c0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 --2- 172.21.15.89:0/3536980869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f633c0b6890 0x7f633c14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 >> 172.21.15.89:0/3536980869 conn(0x7f633c069a30 msgr2=0x7f633c0bbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 shutdown_connections 2023-08-25T09:42:06.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f6342e57640 1 -- 172.21.15.89:0/3536980869 wait complete. 2023-08-25T09:42:06.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.514+0000 7f953d7fa640 1 -- 172.21.15.89:0/3653775044 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95481e2d50 con 0x7f95480b5520 2023-08-25T09:42:06.519 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2023-08-25T09:42:06.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.516+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3c481ece60 con 0x7f3c48141000 2023-08-25T09:42:06.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f953406a150 msgr2=0x7f953406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f953406a150 0x7f953406c610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95481dd410 tx=0x7f9538008040 comp rx=0 tx=0).stop 2023-08-25T09:42:06.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-08-25T09:42:06.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 msgr2=0x7f9548070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 0x7f9548070600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f954402bdb0 tx=0x7f95440046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f3c44ff9640 1 -- 172.21.15.89:0/1710115551 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c4004e020 con 0x7f3c48141000 2023-08-25T09:42:06.522 INFO:teuthology.orchestra.run.smithi089.stdout:55834574852 2023-08-25T09:42:06.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 shutdown_connections 2023-08-25T09:42:06.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f953406a150 0x7f953406c610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f954814bbd0 0x7f95481e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f954813f090 0x7f9548141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 --2- 172.21.15.89:0/3653775044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480b5520 0x7f9548070600 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 >> 172.21.15.89:0/3653775044 conn(0x7f95480bcd40 msgr2=0x7f95480b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 shutdown_connections 2023-08-25T09:42:06.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.517+0000 7f954ef99640 1 -- 172.21.15.89:0/3653775044 wait complete. 2023-08-25T09:42:06.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.519+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60400057d0 con 0x7f606006a580 2023-08-25T09:42:06.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.520+0000 7f605cff9640 1 -- 172.21.15.89:0/1874252576 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6054017020 con 0x7f606006a580 2023-08-25T09:42:06.525 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:06.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.520+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3c3406a050 msgr2=0x7f3c3406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.520+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3c3406a050 0x7f3c3406c510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c38006ca0 tx=0x7f3c38009240 comp rx=0 tx=0).stop 2023-08-25T09:42:06.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 msgr2=0x7f3c481ef320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c481ef320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3c40033000 tx=0x7f3c40004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 shutdown_connections 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3c3406a050 0x7f3c3406c510 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c48141000 0x7f3c481ef320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c4806ed40 0x7f3c481eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 --2- 172.21.15.89:0/1710115551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c4806aad0 0x7f3c481353c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 >> 172.21.15.89:0/1710115551 conn(0x7f3c480b8f80 msgr2=0x7f3c481406c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 shutdown_connections 2023-08-25T09:42:06.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.521+0000 7f3c4d2f9640 1 -- 172.21.15.89:0/1710115551 wait complete. 2023-08-25T09:42:06.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f604c06a0a0 msgr2=0x7f604c06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f604c06a0a0 0x7f604c06c560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6050007af0 tx=0x7f6050008040 comp rx=0 tx=0).stop 2023-08-25T09:42:06.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606006a580 msgr2=0x7f60601ecbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606006a580 0x7f60601ecbb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f605400c440 tx=0x7f6054001e70 comp rx=0 tx=0).stop 2023-08-25T09:42:06.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 shutdown_connections 2023-08-25T09:42:06.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f604c06a0a0 0x7f604c06c560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.529 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60600ba370 0x7f60601ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.522+0000 7f60663e3640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606006a580 0x7f60601ecbb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.523+0000 7f60663e3640 1 --2- 172.21.15.89:0/1874252576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6060069ac0 0x7f60601529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.523+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 >> 172.21.15.89:0/1874252576 conn(0x7f60600b9850 msgr2=0x7f60601489b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.523+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 shutdown_connections 2023-08-25T09:42:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.523+0000 7f60663e3640 1 -- 172.21.15.89:0/1874252576 wait complete. 2023-08-25T09:42:06.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-08-25T09:42:06.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-08-25T09:42:06.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.533+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c90147ab0 con 0x7f7c901f0280 2023-08-25T09:42:06.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-08-25T09:42:06.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.534+0000 7f7c8cff9640 1 -- 172.21.15.89:0/3458974265 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c88018020 con 0x7f7c901f0280 2023-08-25T09:42:06.537 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-08-25T09:42:06.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-08-25T09:42:06.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7c7c06a080 msgr2=0x7f7c7c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7c7c06a080 0x7f7c7c06c540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034000 tx=0x7f7c84008030 comp rx=0 tx=0).stop 2023-08-25T09:42:06.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 msgr2=0x7f7c901511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:06.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 0x7f7c901511b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c8c0 tx=0x7f7c8800cd80 comp rx=0 tx=0).stop 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 shutdown_connections 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7c7c06a080 0x7f7c7c06c540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c900b6cd0 0x7f7c90146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c901f0280 0x7f7c901511b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 --2- 172.21.15.89:0/3458974265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7c900b6890 0x7f7c901408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 >> 172.21.15.89:0/3458974265 conn(0x7f7c90069a30 msgr2=0x7f7c900b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:06.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 shutdown_connections 2023-08-25T09:42:06.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:06.536+0000 7f7c96857640 1 -- 172.21.15.89:0/3458974265 wait complete. 2023-08-25T09:42:06.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-08-25T09:42:06.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-08-25T09:42:07.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T09:42:07.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T09:42:07.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T09:42:07.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T09:42:07.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T09:42:07.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T09:42:07.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T09:42:07.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T09:42:07.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.669+0000 7f458b512640 1 Processor -- start 2023-08-25T09:42:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.669+0000 7f458b512640 1 -- start start 2023-08-25T09:42:07.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.670+0000 7f458b512640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45840b8490 0x7f4584149c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.670+0000 7f458b512640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458414a640 con 0x7f4584140c40 2023-08-25T09:42:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.670+0000 7f458b512640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4584069f60 con 0x7f458414a1b0 2023-08-25T09:42:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.670+0000 7f458b512640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4584070810 con 0x7f45840b8490 2023-08-25T09:42:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.671+0000 7f45892ae640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4584140c40 0x7f4584069850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55842/0 (socket says 172.21.15.89:55842) 2023-08-25T09:42:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.671+0000 7f45892ae640 1 -- 172.21.15.89:0/3995113287 learned_addr learned my addr 172.21.15.89:0/3995113287 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.671+0000 7f4588aad640 1 --2- 172.21.15.89:0/3995113287 >> v2:172.21.15.89:3300/0 conn(0x7f45840b8490 0x7f4584149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.672+0000 7f4588aad640 1 -- 172.21.15.89:0/3995113287 >> v1:172.21.15.121:6789/0 conn(0x7f458414a1b0 legacy=0x7f4584151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.672+0000 7f4588aad640 1 -- 172.21.15.89:0/3995113287 >> v1:172.21.15.89:6789/0 conn(0x7f4584140c40 legacy=0x7f4584069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.672+0000 7f4588aad640 1 -- 172.21.15.89:0/3995113287 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458406f4d0 con 0x7f45840b8490 2023-08-25T09:42:07.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.673+0000 7f4588aad640 1 --2- 172.21.15.89:0/3995113287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f4584149c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45800097a0 tx=0x7f458002b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848550c686e1405b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.674+0000 7f457bfff640 1 -- 172.21.15.89:0/3995113287 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580030710 con 0x7f45840b8490 2023-08-25T09:42:07.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.674+0000 7f457bfff640 1 -- 172.21.15.89:0/3995113287 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458002e050 con 0x7f45840b8490 2023-08-25T09:42:07.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.675+0000 7f458b512640 1 -- 172.21.15.89:0/3995113287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 msgr2=0x7f4584149c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.675+0000 7f458b512640 1 --2- 172.21.15.89:0/3995113287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f4584149c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45800097a0 tx=0x7f458002b680 comp rx=0 tx=0).stop 2023-08-25T09:42:07.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.676+0000 7f458b512640 1 -- 172.21.15.89:0/3995113287 shutdown_connections 2023-08-25T09:42:07.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.676+0000 7f458b512640 1 --2- 172.21.15.89:0/3995113287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f4584149c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.676+0000 7f458b512640 1 -- 172.21.15.89:0/3995113287 >> 172.21.15.89:0/3995113287 conn(0x7f45840bbe70 msgr2=0x7f45840bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.676+0000 7f458b512640 1 -- 172.21.15.89:0/3995113287 shutdown_connections 2023-08-25T09:42:07.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.676+0000 7f458b512640 1 -- 172.21.15.89:0/3995113287 wait complete. 2023-08-25T09:42:07.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.678+0000 7f458b512640 1 Processor -- start 2023-08-25T09:42:07.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.678+0000 7f458b512640 1 -- start start 2023-08-25T09:42:07.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f458b512640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f458413b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f458b512640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4584140c40 0x7f45840bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f458b512640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f458414a1b0 0x7f4584154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f458b512640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4584148ef0 con 0x7f45840b8490 2023-08-25T09:42:07.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f458b512640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458413c0a0 con 0x7f458414a1b0 2023-08-25T09:42:07.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f458b512640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458413c4c0 con 0x7f4584140c40 2023-08-25T09:42:07.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f45892ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f458413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f45892ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f458413b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59682/0 (socket says 172.21.15.89:59682) 2023-08-25T09:42:07.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f45892ae640 1 -- 172.21.15.89:0/825601549 learned_addr learned my addr 172.21.15.89:0/825601549 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f4588aad640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4584140c40 0x7f45840bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.679+0000 7f4589aaf640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f458414a1b0 0x7f4584154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f45892ae640 1 -- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4584140c40 msgr2=0x7f45840bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f45892ae640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4584140c40 0x7f45840bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f45892ae640 1 -- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f458414a1b0 msgr2=0x7f4584154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f45892ae640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f458414a1b0 0x7f4584154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f45892ae640 1 -- 172.21.15.89:0/825601549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580009400 con 0x7f45840b8490 2023-08-25T09:42:07.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f45892ae640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f458413b870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f457c00caf0 tx=0x7f457c002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.680+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00a7a0 con 0x7f45840b8490 2023-08-25T09:42:07.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.681+0000 7f458b512640 1 -- 172.21.15.89:0/825601549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458413c760 con 0x7f45840b8490 2023-08-25T09:42:07.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.681+0000 7f458b512640 1 -- 172.21.15.89:0/825601549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458413cd20 con 0x7f45840b8490 2023-08-25T09:42:07.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.683+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c00a920 con 0x7f45840b8490 2023-08-25T09:42:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.684+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00ad50 con 0x7f45840b8490 2023-08-25T09:42:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.684+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f457c0070d0 con 0x7f45840b8490 2023-08-25T09:42:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.684+0000 7f4579ffb640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f456806a170 0x7f456806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.684+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f457c088160 con 0x7f45840b8490 2023-08-25T09:42:07.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.685+0000 7f4588aad640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f456806a170 0x7f456806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.685+0000 7f4588aad640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f456806a170 0x7f456806c630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4580034000 tx=0x7f4580008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.686+0000 7f458b512640 1 -- 172.21.15.89:0/825601549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4564005250 con 0x7f45840b8490 2023-08-25T09:42:07.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.695+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f457c053970 con 0x7f45840b8490 2023-08-25T09:42:07.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.723+0000 7f7b37846640 1 Processor -- start 2023-08-25T09:42:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.723+0000 7f7b37846640 1 -- start start 2023-08-25T09:42:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b37846640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7b300b8490 0x7f7b30149c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b37846640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3014a640 con 0x7f7b3014a1b0 2023-08-25T09:42:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b37846640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b30069f60 con 0x7f7b30140c40 2023-08-25T09:42:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b37846640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b30070810 con 0x7f7b300b8490 2023-08-25T09:42:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b34de1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7b300b8490 0x7f7b30149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b34de1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7b300b8490 0x7f7b30149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33294/0 (socket says 172.21.15.89:33294) 2023-08-25T09:42:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.724+0000 7f7b34de1640 1 -- 172.21.15.89:0/302433026 learned_addr learned my addr 172.21.15.89:0/302433026 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.725+0000 7f37e9bbc640 1 Processor -- start 2023-08-25T09:42:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.725+0000 7f37e9bbc640 1 -- start start 2023-08-25T09:42:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f13ab10c640 1 Processor -- start 2023-08-25T09:42:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f13ab10c640 1 -- start start 2023-08-25T09:42:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.725+0000 7f7b34de1640 1 -- 172.21.15.89:0/302433026 >> v1:172.21.15.121:6789/0 conn(0x7f7b30140c40 legacy=0x7f7b30069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.725+0000 7f7b34de1640 1 -- 172.21.15.89:0/302433026 >> v1:172.21.15.89:6789/0 conn(0x7f7b3014a1b0 legacy=0x7f7b30151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.725+0000 7f7b34de1640 1 -- 172.21.15.89:0/302433026 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3006f4d0 con 0x7f7b300b8490 2023-08-25T09:42:07.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f7b34de1640 1 --2- 172.21.15.89:0/302433026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b300b8490 0x7f7b30149c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009bd0 tx=0x7f7b2802d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a4ada074735edd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f37e9bbc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f37e4140c40 0x7f37e4069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f37e9bbc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4149c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7fbcf5034640 1 Processor -- start 2023-08-25T09:42:07.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f37e9bbc640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e406f4d0 con 0x7f37e40bc960 2023-08-25T09:42:07.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f37e9bbc640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e4070810 con 0x7f37e4140c40 2023-08-25T09:42:07.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f37e9bbc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e406f7b0 con 0x7f37e40b8490 2023-08-25T09:42:07.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.726+0000 7f7b27fff640 1 -- 172.21.15.89:0/302433026 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28034600 con 0x7f7b300b8490 2023-08-25T09:42:07.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f7b27fff640 1 -- 172.21.15.89:0/302433026 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28030050 con 0x7f7b300b8490 2023-08-25T09:42:07.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f7b27fff640 1 -- 172.21.15.89:0/302433026 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28034980 con 0x7f7b300b8490 2023-08-25T09:42:07.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7fbcf5034640 1 -- start start 2023-08-25T09:42:07.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f37e4140c40 0x7f37e4069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f37e4140c40 0x7f37e4069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33308/0 (socket says 172.21.15.89:33308) 2023-08-25T09:42:07.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 -- 172.21.15.89:0/4010604563 learned_addr learned my addr 172.21.15.89:0/4010604563 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e2ffd640 1 --2- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13ab10c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 0x7f13a40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13ab10c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f13a406ea80 0x7f13a406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13ab10c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13a406f4e0 0x7f13a41488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f7b37846640 1 -- 172.21.15.89:0/302433026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b300b8490 msgr2=0x7f7b30149c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f7b37846640 1 --2- 172.21.15.89:0/302433026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b300b8490 0x7f7b30149c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009bd0 tx=0x7f7b2802d490 comp rx=0 tx=0).stop 2023-08-25T09:42:07.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 -- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 msgr2=0x7f37e4149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 --2- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 -- 172.21.15.89:0/4010604563 >> v1:172.21.15.121:6789/0 conn(0x7f37e40bc960 legacy=0x7f37e4146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f37e37fe640 1 -- 172.21.15.89:0/4010604563 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e406fa90 con 0x7f37e4140c40 2023-08-25T09:42:07.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13ab10c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a4070390 con 0x7f13a406f4e0 2023-08-25T09:42:07.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13a8ea8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 0x7f13a40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13ab10c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40b5e00 con 0x7f13a406ea80 2023-08-25T09:42:07.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13ab10c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a40716e0 con 0x7f13a4069ac0 2023-08-25T09:42:07.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13a8ea8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 0x7f13a40711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49388/0 (socket says 172.21.15.89:49388) 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13a8ea8640 1 -- 172.21.15.89:0/1715285925 learned_addr learned my addr 172.21.15.89:0/1715285925 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13a3fff640 1 --2- 172.21.15.89:0/1715285925 >> v2:172.21.15.121:3300/0 conn(0x7f13a406ea80 0x7f13a406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7f13a96a9640 1 --2- 172.21.15.89:0/1715285925 >> v2:172.21.15.89:3300/0 conn(0x7f13a406f4e0 0x7f13a41488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f13a8ea8640 1 -- 172.21.15.89:0/1715285925 >> v2:172.21.15.121:3300/0 conn(0x7f13a406ea80 msgr2=0x7f13a406efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f13a8ea8640 1 --2- 172.21.15.89:0/1715285925 >> v2:172.21.15.121:3300/0 conn(0x7f13a406ea80 0x7f13a406efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f13a8ea8640 1 -- 172.21.15.89:0/1715285925 >> v2:172.21.15.89:3300/0 conn(0x7f13a406f4e0 msgr2=0x7f13a41488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f13a8ea8640 1 --2- 172.21.15.89:0/1715285925 >> v2:172.21.15.89:3300/0 conn(0x7f13a406f4e0 0x7f13a41488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f13a8ea8640 1 -- 172.21.15.89:0/1715285925 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a406f970 con 0x7f13a4069ac0 2023-08-25T09:42:07.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7fc21fad9640 1 Processor -- start 2023-08-25T09:42:07.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.727+0000 7fbcf5034640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbce803e0d0 0x7fbce80c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcf5034640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce8037060 con 0x7fbce80cdbc0 2023-08-25T09:42:07.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcf5034640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80ce680 con 0x7fbce8037f10 2023-08-25T09:42:07.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcf5034640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80ce960 con 0x7fbce803e0d0 2023-08-25T09:42:07.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbceed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbce803e0d0 0x7fbce80c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcee59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbce80cdbc0 0x7fbce8037800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55864/0 (socket says 172.21.15.89:55864) 2023-08-25T09:42:07.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcee59c640 1 -- 172.21.15.89:0/920859618 learned_addr learned my addr 172.21.15.89:0/920859618 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:07.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f7b37846640 1 -- 172.21.15.89:0/302433026 shutdown_connections 2023-08-25T09:42:07.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f7b37846640 1 --2- 172.21.15.89:0/302433026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b300b8490 0x7f7b30149c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.741 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f7b37846640 1 -- 172.21.15.89:0/302433026 >> 172.21.15.89:0/302433026 conn(0x7f7b300bbe70 msgr2=0x7f7b300bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcedd9b640 1 -- 172.21.15.89:0/920859618 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954923132 0 0) 0x7fbce8037060 con 0x7fbce80cdbc0 2023-08-25T09:42:07.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbcedd9b640 1 -- 172.21.15.89:0/920859618 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd8003520 con 0x7fbce80cdbc0 2023-08-25T09:42:07.742 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f7b37846640 1 -- 172.21.15.89:0/302433026 shutdown_connections 2023-08-25T09:42:07.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f7b37846640 1 -- 172.21.15.89:0/302433026 wait complete. 2023-08-25T09:42:07.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7f37e37fe640 1 --2- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4069850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d150 tx=0x7f37dc02e060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd498b2df97e285c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f37e27fc640 1 -- 172.21.15.89:0/4010604563 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc02ee10 con 0x7f37e4140c40 2023-08-25T09:42:07.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f37e27fc640 1 -- 172.21.15.89:0/4010604563 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc032070 con 0x7f37e4140c40 2023-08-25T09:42:07.743 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f37e27fc640 1 -- 172.21.15.89:0/4010604563 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc038620 con 0x7f37e4140c40 2023-08-25T09:42:07.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fc21fad9640 1 -- start start 2023-08-25T09:42:07.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21fad9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc218140c40 0x7fc218069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21fad9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21806f4d0 con 0x7fc2180b8490 2023-08-25T09:42:07.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21fad9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21806f7b0 con 0x7fc2180bc960 2023-08-25T09:42:07.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21fad9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc218070810 con 0x7fc218140c40 2023-08-25T09:42:07.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbceed9d640 1 -- 172.21.15.89:0/920859618 >> v1:172.21.15.121:6789/0 conn(0x7fbce8037f10 legacy=0x7fbce80d8520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T09:42:07.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbceed9d640 1 -- 172.21.15.89:0/920859618 >> v1:172.21.15.89:6789/0 conn(0x7fbce80cdbc0 legacy=0x7fbce8037800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.728+0000 7fbceed9d640 1 -- 172.21.15.89:0/920859618 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80372e0 con 0x7fbce803e0d0 2023-08-25T09:42:07.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f13a8ea8640 1 --2- 172.21.15.89:0/1715285925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 0x7f13a40711a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f13a40bcce0 tx=0x7f139802b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=480894ac36904e34 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21e076640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc2180bc960 0x7fc218146e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:50004/0 (socket says 172.21.15.89:50004) 2023-08-25T09:42:07.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21e076640 1 -- 172.21.15.89:0/1664964043 learned_addr learned my addr 172.21.15.89:0/1664964043 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:07.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f76f8fab640 1 Processor -- start 2023-08-25T09:42:07.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f76f8fab640 1 -- start start 2023-08-25T09:42:07.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f13a37fe640 1 -- 172.21.15.89:0/1715285925 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398031880 con 0x7f13a4069ac0 2023-08-25T09:42:07.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f13a37fe640 1 -- 172.21.15.89:0/1715285925 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980319e0 con 0x7f13a4069ac0 2023-08-25T09:42:07.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7f13a37fe640 1 -- 172.21.15.89:0/1715285925 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398031d70 con 0x7f13a4069ac0 2023-08-25T09:42:07.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21d875640 1 --2- 172.21.15.89:0/1664964043 >> v2:172.21.15.121:3300/0 conn(0x7fc218140c40 0x7fc218069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7faa6288a640 1 Processor -- start 2023-08-25T09:42:07.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21c873640 1 -- 172.21.15.89:0/1664964043 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330189662 0 0) 0x7fc21806f7b0 con 0x7fc2180bc960 2023-08-25T09:42:07.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.729+0000 7fc21c873640 1 -- 172.21.15.89:0/1664964043 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc204003440 con 0x7fc2180bc960 2023-08-25T09:42:07.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 -- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 msgr2=0x7f37e4069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4069850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d150 tx=0x7f37dc02e060 comp rx=0 tx=0).stop 2023-08-25T09:42:07.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fbceed9d640 1 --2- 172.21.15.89:0/920859618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce803e0d0 0x7fbce80c7950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbce000ba40 tx=0x7fbce002e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75e2a2970ced9e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fc21d875640 1 -- 172.21.15.89:0/1664964043 >> v1:172.21.15.121:6789/0 conn(0x7fc2180bc960 legacy=0x7fc218146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fc21c873640 1 -- 172.21.15.89:0/1664964043 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49242077 0 0) 0x7fc204003440 con 0x7fc2180bc960 2023-08-25T09:42:07.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fc21d875640 1 -- 172.21.15.89:0/1664964043 >> v1:172.21.15.89:6789/0 conn(0x7fc2180b8490 legacy=0x7fc218146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fc21d875640 1 -- 172.21.15.89:0/1664964043 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21806fa90 con 0x7fc218140c40 2023-08-25T09:42:07.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 -- 172.21.15.89:0/4010604563 shutdown_connections 2023-08-25T09:42:07.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/4010604563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4069850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 -- 172.21.15.89:0/4010604563 >> 172.21.15.89:0/4010604563 conn(0x7f37e40bbe70 msgr2=0x7f37e40bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f8fab640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f76ec0d04e0 0x7f76ec03b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f8fab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76ec039cc0 0x7f76ec03a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f8fab640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec03a670 con 0x7f76ec007140 2023-08-25T09:42:07.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f8fab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec03ae90 con 0x7f76ec039cc0 2023-08-25T09:42:07.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f8fab640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0d0ae0 con 0x7f76ec0d04e0 2023-08-25T09:42:07.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 -- 172.21.15.89:0/4010604563 shutdown_connections 2023-08-25T09:42:07.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f7b37846640 1 Processor -- start 2023-08-25T09:42:07.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f7b37846640 1 -- start start 2023-08-25T09:42:07.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f7b37846640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b300b8490 0x7f7b301e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f7b37846640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b30140c40 0x7f7b300b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f7b37846640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 0x7f7b301386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f7b37846640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b301e7930 con 0x7f7b300b8490 2023-08-25T09:42:07.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f7b37846640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30144ab0 con 0x7f7b30140c40 2023-08-25T09:42:07.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f7b37846640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30139770 con 0x7f7b3014a1b0 2023-08-25T09:42:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f37e9bbc640 1 -- 172.21.15.89:0/4010604563 wait complete. 2023-08-25T09:42:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f1d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f76ec0d04e0 0x7f76ec03b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f76ec007140 0x7f76ec0c6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:50016/0 (socket says 172.21.15.89:50016) 2023-08-25T09:42:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f259c640 1 -- 172.21.15.89:0/1664864208 learned_addr learned my addr 172.21.15.89:0/1664864208 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7f76f2d9d640 1 --2- 172.21.15.89:0/1664864208 >> v2:172.21.15.89:3300/0 conn(0x7f76ec039cc0 0x7f76ec03a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f159a640 1 -- 172.21.15.89:0/1664864208 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319821551 0 0) 0x7f76ec03a670 con 0x7f76ec007140 2023-08-25T09:42:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f159a640 1 -- 172.21.15.89:0/1664864208 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76dc005730 con 0x7f76ec007140 2023-08-25T09:42:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f1d9b640 1 -- 172.21.15.89:0/1664864208 >> v2:172.21.15.89:3300/0 conn(0x7f76ec039cc0 msgr2=0x7f76ec03a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f1d9b640 1 --2- 172.21.15.89:0/1664864208 >> v2:172.21.15.89:3300/0 conn(0x7f76ec039cc0 0x7f76ec03a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f1d9b640 1 -- 172.21.15.89:0/1664864208 >> v1:172.21.15.121:6789/0 conn(0x7f76ec007140 legacy=0x7f76ec0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f1d9b640 1 -- 172.21.15.89:0/1664864208 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0d0dc0 con 0x7f76ec0d04e0 2023-08-25T09:42:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f76f2d9d640 1 --2- 172.21.15.89:0/1664864208 >> v2:172.21.15.89:3300/0 conn(0x7f76ec039cc0 0x7f76ec03a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 -- 172.21.15.89:0/1715285925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 msgr2=0x7f13a40711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 --2- 172.21.15.89:0/1715285925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 0x7f13a40711a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f13a40bcce0 tx=0x7f139802b920 comp rx=0 tx=0).stop 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 -- 172.21.15.89:0/1715285925 shutdown_connections 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 --2- 172.21.15.89:0/1715285925 >> v2:172.21.15.89:3300/0 conn(0x7f13a406f4e0 0x7f13a41488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 --2- 172.21.15.89:0/1715285925 >> v2:172.21.15.121:3300/0 conn(0x7f13a406ea80 0x7f13a406efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 --2- 172.21.15.89:0/1715285925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a4069ac0 0x7f13a40711a0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f13a40bcce0 tx=0x7f139802b920 comp rx=0 tx=0).stop 2023-08-25T09:42:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 -- 172.21.15.89:0/1715285925 >> 172.21.15.89:0/1715285925 conn(0x7f13a40bbe70 msgr2=0x7f13a40bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fbcedd9b640 1 -- 172.21.15.89:0/920859618 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0036440 con 0x7fbce803e0d0 2023-08-25T09:42:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fbcedd9b640 1 -- 172.21.15.89:0/920859618 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00365a0 con 0x7fbce803e0d0 2023-08-25T09:42:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7fbcedd9b640 1 -- 172.21.15.89:0/920859618 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0036930 con 0x7fbce803e0d0 2023-08-25T09:42:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7fbcf5034640 1 -- 172.21.15.89:0/920859618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce803e0d0 msgr2=0x7fbce80c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7fbcf5034640 1 --2- 172.21.15.89:0/920859618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce803e0d0 0x7fbce80c7950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbce000ba40 tx=0x7fbce002e130 comp rx=0 tx=0).stop 2023-08-25T09:42:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.730+0000 7faa6288a640 1 -- start start 2023-08-25T09:42:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa6288a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faa5c14c120 0x7faa5c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa6288a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faa5c071570 0x7faa5c0b8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa6288a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c0b8b00 0x7faa5c152050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa6288a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0704d0 con 0x7faa5c14c120 2023-08-25T09:42:07.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa6288a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0719e0 con 0x7faa5c071570 2023-08-25T09:42:07.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa6288a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0711c0 con 0x7faa5c0b8b00 2023-08-25T09:42:07.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7fc21d875640 1 --2- 172.21.15.89:0/1664964043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc218140c40 0x7fc218069850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc210009d90 tx=0x7fc21002bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb9d52719cd52b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7fbcf5034640 1 -- 172.21.15.89:0/920859618 shutdown_connections 2023-08-25T09:42:07.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7fbcf5034640 1 --2- 172.21.15.89:0/920859618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce803e0d0 0x7fbce80c7950 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7fbcf5034640 1 -- 172.21.15.89:0/920859618 >> 172.21.15.89:0/920859618 conn(0x7fbce803ee50 msgr2=0x7fbce803f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 0x7f7b301386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b34de1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b30140c40 0x7f7b300b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f37e9bbc640 1 Processor -- start 2023-08-25T09:42:07.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 0x7f7b301386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49400/0 (socket says 172.21.15.89:49400) 2023-08-25T09:42:07.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 -- 172.21.15.89:0/3311287112 learned_addr learned my addr 172.21.15.89:0/3311287112 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b355e2640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b300b8490 0x7f7b301e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7fc21c873640 1 -- 172.21.15.89:0/1664964043 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208001670 con 0x7fc218140c40 2023-08-25T09:42:07.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7fc21c873640 1 -- 172.21.15.89:0/1664964043 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21002c820 con 0x7fc218140c40 2023-08-25T09:42:07.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7fc21c873640 1 -- 172.21.15.89:0/1664964043 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21002cbb0 con 0x7fc218140c40 2023-08-25T09:42:07.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f76f1d9b640 1 --2- 172.21.15.89:0/1664864208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec03b540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76ec03c6f0 tx=0x7f76e402b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aa1d73803eb41c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 -- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b30140c40 msgr2=0x7f7b300b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b30140c40 0x7f7b300b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 -- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b300b8490 msgr2=0x7f7b301e73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b300b8490 0x7f7b301e73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 -- 172.21.15.89:0/3311287112 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b28009830 con 0x7f7b3014a1b0 2023-08-25T09:42:07.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f76f159a640 1 -- 172.21.15.89:0/1664864208 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4008be0 con 0x7f76ec0d04e0 2023-08-25T09:42:07.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f76f159a640 1 -- 172.21.15.89:0/1664864208 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e402e070 con 0x7f76ec0d04e0 2023-08-25T09:42:07.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f76f159a640 1 -- 172.21.15.89:0/1664864208 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400a0d0 con 0x7f76ec0d04e0 2023-08-25T09:42:07.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f37e9bbc640 1 -- start start 2023-08-25T09:42:07.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f7b35de3640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 0x7f7b301386d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000c3c0 tx=0x7f7b2000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 -- 172.21.15.89:0/1664964043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc218140c40 msgr2=0x7fc218069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 --2- 172.21.15.89:0/1664964043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc218140c40 0x7fc218069850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc210009d90 tx=0x7fc21002bcf0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 -- 172.21.15.89:0/1664964043 shutdown_connections 2023-08-25T09:42:07.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 --2- 172.21.15.89:0/1664964043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc218140c40 0x7fc218069850 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 -- 172.21.15.89:0/1664964043 >> 172.21.15.89:0/1664964043 conn(0x7fc2180bbe70 msgr2=0x7fc2180bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e9bbc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200052d0 con 0x7f7b3014a1b0 2023-08-25T09:42:07.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b20005450 con 0x7f7b3014a1b0 2023-08-25T09:42:07.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20003830 con 0x7f7b3014a1b0 2023-08-25T09:42:07.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e9bbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 0x7f37e4148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 -- 172.21.15.89:0/1664964043 shutdown_connections 2023-08-25T09:42:07.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7fc21fad9640 1 -- 172.21.15.89:0/1664964043 wait complete. 2023-08-25T09:42:07.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e9bbc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 0x7f37e4148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 0x7f37e4148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59744/0 (socket says 172.21.15.89:59744) 2023-08-25T09:42:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e37fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e37fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49416/0 (socket says 172.21.15.89:49416) 2023-08-25T09:42:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e2ffd640 1 -- 172.21.15.89:0/2051322713 learned_addr learned my addr 172.21.15.89:0/2051322713 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f76f8fab640 1 -- 172.21.15.89:0/1664864208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 msgr2=0x7f76ec03b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f76f8fab640 1 --2- 172.21.15.89:0/1664864208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec03b540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76ec03c6f0 tx=0x7f76e402b850 comp rx=0 tx=0).stop 2023-08-25T09:42:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300b60b0 con 0x7f7b3014a1b0 2023-08-25T09:42:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b301474b0 con 0x7f7b3014a1b0 2023-08-25T09:42:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e3fff640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4148410 con 0x7f37e40bc960 2023-08-25T09:42:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e41493f0 con 0x7f37e4140c40 2023-08-25T09:42:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7f13ab10c640 1 -- 172.21.15.89:0/1715285925 shutdown_connections 2023-08-25T09:42:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7f13ab10c640 1 -- 172.21.15.89:0/1715285925 wait complete. 2023-08-25T09:42:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f13ab10c640 1 Processor -- start 2023-08-25T09:42:07.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e41dc050 con 0x7f37e40b8490 2023-08-25T09:42:07.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa61888640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faa5c14c120 0x7faa5c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa61888640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faa5c14c120 0x7faa5c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59728/0 (socket says 172.21.15.89:59728) 2023-08-25T09:42:07.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.731+0000 7faa61888640 1 -- 172.21.15.89:0/4253932877 learned_addr learned my addr 172.21.15.89:0/4253932877 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.732+0000 7faa62089640 1 --2- 172.21.15.89:0/4253932877 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c0b8b00 0x7faa5c152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7faa61087640 1 --2- 172.21.15.89:0/4253932877 >> v2:172.21.15.121:3300/0 conn(0x7faa5c071570 0x7faa5c0b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7faa62089640 1 -- 172.21.15.89:0/4253932877 >> v2:172.21.15.121:3300/0 conn(0x7faa5c071570 msgr2=0x7faa5c0b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7faa62089640 1 --2- 172.21.15.89:0/4253932877 >> v2:172.21.15.121:3300/0 conn(0x7faa5c071570 0x7faa5c0b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7faa62089640 1 -- 172.21.15.89:0/4253932877 >> v2:172.21.15.89:3300/0 conn(0x7faa5c14c120 msgr2=0x7faa5c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7faa62089640 1 --2- 172.21.15.89:0/4253932877 >> v2:172.21.15.89:3300/0 conn(0x7faa5c14c120 0x7faa5c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.733+0000 7faa62089640 1 -- 172.21.15.89:0/4253932877 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c06ea70 con 0x7faa5c0b8b00 2023-08-25T09:42:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f37e2ffd640 1 -- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 msgr2=0x7f37e4147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f37e2ffd640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f37e2ffd640 1 -- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 msgr2=0x7f37e4135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f37e2ffd640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f37e2ffd640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc00bd40 con 0x7f37e40bc960 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f37e2ffd640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 0x7f37e4148eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37d800e980 tx=0x7f37d800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8009670 con 0x7f37e40bc960 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d800ca00 con 0x7f37e40bc960 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800cd90 con 0x7f37e40bc960 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e4149630 con 0x7f37e40bc960 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e41db720 con 0x7f37e40bc960 2023-08-25T09:42:07.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7f13ab10c640 1 -- start start 2023-08-25T09:42:07.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7fc21fad9640 1 Processor -- start 2023-08-25T09:42:07.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7fc21fad9640 1 -- start start 2023-08-25T09:42:07.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7fbcf5034640 1 -- 172.21.15.89:0/920859618 shutdown_connections 2023-08-25T09:42:07.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7faa62089640 1 --2- 172.21.15.89:0/4253932877 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c0b8b00 0x7faa5c152050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0b3380 tx=0x7faa4c02b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80a282b557deb6cf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7faa60886640 1 -- 172.21.15.89:0/4253932877 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c030710 con 0x7faa5c0b8b00 2023-08-25T09:42:07.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7faa60886640 1 -- 172.21.15.89:0/4253932877 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c02e050 con 0x7faa5c0b8b00 2023-08-25T09:42:07.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7faa60886640 1 -- 172.21.15.89:0/4253932877 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c030a90 con 0x7faa5c0b8b00 2023-08-25T09:42:07.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7fc21fad9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2180b8490 0x7fc218148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7fc21fad9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 0x7fc2180baf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7fc21fad9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc218140c40 0x7fc2181decd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7fc21fad9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180bb450 con 0x7fc218140c40 2023-08-25T09:42:07.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7fc21fad9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2181de880 con 0x7fc2180bc960 2023-08-25T09:42:07.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7fc21fad9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc218147c10 con 0x7fc2180b8490 2023-08-25T09:42:07.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.734+0000 7fbcf5034640 1 -- 172.21.15.89:0/920859618 wait complete. 2023-08-25T09:42:07.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f13ab10c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13a406ea80 0x7f13a41508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 0x7fc2180baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 0x7fc2180baf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33372/0 (socket says 172.21.15.89:33372) 2023-08-25T09:42:07.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 -- 172.21.15.89:0/4053040787 learned_addr learned my addr 172.21.15.89:0/4053040787 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f13ab10c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 0x7f13a4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f13ab10c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a4146140 0x7f13a4152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13ab10c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4150e20 con 0x7f13a4146140 2023-08-25T09:42:07.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13ab10c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4151310 con 0x7f13a406ea80 2023-08-25T09:42:07.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13ab10c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4150330 con 0x7f13a406f4e0 2023-08-25T09:42:07.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21e076640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc218140c40 0x7fc2181decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d875640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2180b8490 0x7fc218148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 0x7f13a4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 0x7f13a4152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:49428/0 (socket says 172.21.15.89:49428) 2023-08-25T09:42:07.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 -- 172.21.15.89:0/3756839331 learned_addr learned my addr 172.21.15.89:0/3756839331 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b10005250 con 0x7f7b3014a1b0 2023-08-25T09:42:07.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b20003990 con 0x7f7b3014a1b0 2023-08-25T09:42:07.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.735+0000 7f7b25ffb640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b1406a050 0x7f7b1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b20087870 con 0x7f7b3014a1b0 2023-08-25T09:42:07.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f7b355e2640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b1406a050 0x7f7b1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a96a9640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a4146140 0x7f13a4152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a8ea8640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13a406ea80 0x7f13a41508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 -- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2180b8490 msgr2=0x7fc218148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2180b8490 0x7fc218148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 -- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc218140c40 msgr2=0x7fc2181decd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc218140c40 0x7fc2181decd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 -- 172.21.15.89:0/4053040787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009a70 con 0x7fc2180bc960 2023-08-25T09:42:07.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 -- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13a406ea80 msgr2=0x7f13a41508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13a406ea80 0x7f13a41508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 -- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a4146140 msgr2=0x7f13a4152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a4146140 0x7f13a4152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f13a3fff640 1 -- 172.21.15.89:0/3756839331 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980094d0 con 0x7f13a406f4e0 2023-08-25T09:42:07.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7f7b355e2640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b1406a050 0x7f7b1406c510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c000f60 tx=0x7f7b2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.736+0000 7fc21d074640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 0x7fc2180baf10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c400 tx=0x7fc21400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f13a3fff640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 0x7f13a4152600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f139400e9e0 tx=0x7f139400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f76f8fab640 1 -- 172.21.15.89:0/1664864208 shutdown_connections 2023-08-25T09:42:07.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f76f8fab640 1 --2- 172.21.15.89:0/1664864208 >> v2:172.21.15.89:3300/0 conn(0x7f76ec039cc0 0x7f76ec03a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f76f8fab640 1 --2- 172.21.15.89:0/1664864208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec03b540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f76f8fab640 1 -- 172.21.15.89:0/1664864208 >> 172.21.15.89:0/1664864208 conn(0x7f76ec03ee50 msgr2=0x7f76ec03f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2140035f0 con 0x7fc2180bc960 2023-08-25T09:42:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc214003750 con 0x7fc2180bc960 2023-08-25T09:42:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214003b40 con 0x7fc2180bc960 2023-08-25T09:42:07.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc218147e60 con 0x7fc2180bc960 2023-08-25T09:42:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc218148420 con 0x7fc2180bc960 2023-08-25T09:42:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7fbcf5034640 1 Processor -- start 2023-08-25T09:42:07.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f76f8fab640 1 -- 172.21.15.89:0/1664864208 shutdown_connections 2023-08-25T09:42:07.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f76f8fab640 1 -- 172.21.15.89:0/1664864208 wait complete. 2023-08-25T09:42:07.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.737+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e404dbd0 con 0x7f37e40bc960 2023-08-25T09:42:07.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 -- 172.21.15.89:0/4253932877 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c0b8b00 msgr2=0x7faa5c152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 --2- 172.21.15.89:0/4253932877 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c0b8b00 0x7faa5c152050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0b3380 tx=0x7faa4c02b710 comp rx=0 tx=0).stop 2023-08-25T09:42:07.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 -- 172.21.15.89:0/4253932877 shutdown_connections 2023-08-25T09:42:07.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 --2- 172.21.15.89:0/4253932877 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c0b8b00 0x7faa5c152050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 --2- 172.21.15.89:0/4253932877 >> v2:172.21.15.121:3300/0 conn(0x7faa5c071570 0x7faa5c0b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 --2- 172.21.15.89:0/4253932877 >> v2:172.21.15.89:3300/0 conn(0x7faa5c14c120 0x7faa5c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 -- 172.21.15.89:0/4253932877 >> 172.21.15.89:0/4253932877 conn(0x7faa5c069850 msgr2=0x7faa5c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:07.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f37d8013470 con 0x7f37e40bc960 2023-08-25T09:42:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 -- 172.21.15.89:0/4253932877 shutdown_connections 2023-08-25T09:42:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7faa6288a640 1 -- 172.21.15.89:0/4253932877 wait complete. 2023-08-25T09:42:07.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7f37cbfff640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37d006a080 0x7f37d006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21804dbd0 con 0x7fc2180bc960 2023-08-25T09:42:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37d8088730 con 0x7f37e40bc960 2023-08-25T09:42:07.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7f37e37fe640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37d006a080 0x7f37d006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.738+0000 7fbcf5034640 1 -- start start 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcf5034640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce8037f10 0x7fbce8033e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcf5034640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce803e0d0 0x7fbce8039ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcf5034640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce80cdbc0 0x7fbce803aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcf5034640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80343b0 con 0x7fbce80cdbc0 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcf5034640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8039aa0 con 0x7fbce8037f10 2023-08-25T09:42:07.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcf5034640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8034ca0 con 0x7fbce803e0d0 2023-08-25T09:42:07.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7f37e37fe640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37d006a080 0x7f37d006c540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37dc039000 tx=0x7f37dc034000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7f76f8fab640 1 Processor -- start 2023-08-25T09:42:07.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbceed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce8037f10 0x7fbce8033e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbceed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce8037f10 0x7fbce8033e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33384/0 (socket says 172.21.15.89:33384) 2023-08-25T09:42:07.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbceed9d640 1 -- 172.21.15.89:0/189986286 learned_addr learned my addr 172.21.15.89:0/189986286 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcee59c640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce803e0d0 0x7fbce8039ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fbcef59e640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce80cdbc0 0x7fbce803aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc214003ca0 con 0x7fc2180bc960 2023-08-25T09:42:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7faa6288a640 1 Processor -- start 2023-08-25T09:42:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7faa6288a640 1 -- start start 2023-08-25T09:42:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fbcef59e640 1 -- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce803e0d0 msgr2=0x7fbce8039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fbcef59e640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce803e0d0 0x7fbce8039ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fbcef59e640 1 -- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce8037f10 msgr2=0x7fbce8033e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fbcef59e640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce8037f10 0x7fbce8033e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fc20e7fc640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1fc06a0a0 0x7fc1fc06c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fbcef59e640 1 -- 172.21.15.89:0/189986286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce000b6a0 con 0x7fbce80cdbc0 2023-08-25T09:42:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc214087a00 con 0x7fc2180bc960 2023-08-25T09:42:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa6288a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa5c071570 0x7faa5c1368b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa6288a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 0x7faa5c0bc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.739+0000 7f76f8fab640 1 -- start start 2023-08-25T09:42:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394009670 con 0x7f13a406f4e0 2023-08-25T09:42:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400c9d0 con 0x7f13a406f4e0 2023-08-25T09:42:07.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa6288a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c14c120 0x7faa5c149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa6288a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0bcdd0 con 0x7faa5c0b8b00 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa6288a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c14db50 con 0x7faa5c071570 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa6288a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c138850 con 0x7faa5c14c120 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa61087640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 0x7faa5c0bc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa61087640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 0x7faa5c0bc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59790/0 (socket says 172.21.15.89:59790) 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa61087640 1 -- 172.21.15.89:0/2264233288 learned_addr learned my addr 172.21.15.89:0/2264233288 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400cd80 con 0x7f13a406f4e0 2023-08-25T09:42:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b200530a0 con 0x7f7b3014a1b0 2023-08-25T09:42:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f8fab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec007140 0x7f76ec026a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f8fab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76ec039cc0 0x7f76ec025800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f8fab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec023ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f8fab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec026f70 con 0x7f76ec007140 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f8fab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0cad50 con 0x7f76ec0d04e0 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f8fab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec023d50 con 0x7f76ec039cc0 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f1d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76ec039cc0 0x7f76ec025800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec007140 0x7f76ec026a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec007140 0x7f76ec026a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59796/0 (socket says 172.21.15.89:59796) 2023-08-25T09:42:07.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f259c640 1 -- 172.21.15.89:0/2211914276 learned_addr learned my addr 172.21.15.89:0/2211914276 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:07.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7f76f2d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec023ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a4145f00 con 0x7f13a406f4e0 2023-08-25T09:42:07.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a414fce0 con 0x7f13a406f4e0 2023-08-25T09:42:07.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7fc21d875640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1fc06a0a0 0x7fc1fc06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7fbcef59e640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce80cdbc0 0x7fbce803aa70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcf004e980 tx=0x7fbcf0066bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa61888640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa5c071570 0x7faa5c1368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.740+0000 7faa62089640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c14c120 0x7faa5c149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7faa61087640 1 -- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c14c120 msgr2=0x7faa5c149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7faa61087640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c14c120 0x7faa5c149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7faa61087640 1 -- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa5c071570 msgr2=0x7faa5c1368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7faa61087640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa5c071570 0x7faa5c1368b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7faa61087640 1 -- 172.21.15.89:0/2264233288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009400 con 0x7faa5c0b8b00 2023-08-25T09:42:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.741+0000 7faa61087640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 0x7faa5c0bc890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa5800e870 tx=0x7faa5800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f1d9b640 1 -- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 msgr2=0x7f76ec023ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f1d9b640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec023ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f1d9b640 1 -- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec007140 msgr2=0x7f76ec026a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:07.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f1d9b640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec007140 0x7f76ec026a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:07.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f1d9b640 1 -- 172.21.15.89:0/2211914276 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009400 con 0x7f76ec039cc0 2023-08-25T09:42:07.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a4150470 con 0x7f13a406f4e0 2023-08-25T09:42:07.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7fc21d875640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1fc06a0a0 0x7fc1fc06c560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc210036000 tx=0x7fc210030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f1d9b640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76ec039cc0 0x7f76ec025800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0d0c20 tx=0x7f76e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4008ea0 con 0x7f76ec039cc0 2023-08-25T09:42:07.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e400ae30 con 0x7f76ec039cc0 2023-08-25T09:42:07.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.742+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec022f60 con 0x7f76ec039cc0 2023-08-25T09:42:07.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.743+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1394013470 con 0x7f13a406f4e0 2023-08-25T09:42:07.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.743+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4006e10 con 0x7f76ec039cc0 2023-08-25T09:42:07.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.743+0000 7f13a17fa640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f139006a0d0 0x7f139006c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.743+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13940889c0 con 0x7f13a406f4e0 2023-08-25T09:42:07.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.743+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e403c680 con 0x7f76ec039cc0 2023-08-25T09:42:07.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.744+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d8005250 con 0x7f76ec039cc0 2023-08-25T09:42:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.743+0000 7f13a8ea8640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f139006a0d0 0x7f139006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.744+0000 7f13a8ea8640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f139006a0d0 0x7f139006c590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1398036000 tx=0x7f139803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f37d8053ec0 con 0x7f37e40bc960 2023-08-25T09:42:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf006bea0 con 0x7fbce80cdbc0 2023-08-25T09:42:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.746+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76e403c7e0 con 0x7f76ec039cc0 2023-08-25T09:42:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.746+0000 7f76e2ffd640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f76d406a020 0x7f76d406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.746+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc214053210 con 0x7fc2180bc960 2023-08-25T09:42:07.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce803c0a0 con 0x7fbce80cdbc0 2023-08-25T09:42:07.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce803a430 con 0x7fbce80cdbc0 2023-08-25T09:42:07.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800ee60 con 0x7faa5c0b8b00 2023-08-25T09:42:07.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c137fb0 con 0x7faa5c0b8b00 2023-08-25T09:42:07.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.745+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c138570 con 0x7faa5c0b8b00 2023-08-25T09:42:07.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.746+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58005990 con 0x7faa5c0b8b00 2023-08-25T09:42:07.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.747+0000 7f76f259c640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f76d406a020 0x7f76d406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.747+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58005d00 con 0x7faa5c0b8b00 2023-08-25T09:42:07.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.747+0000 7f76f259c640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f76d406a020 0x7f76d406c4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76f4067ec0 tx=0x7f76f40689c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.747+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0073070 con 0x7fbce80cdbc0 2023-08-25T09:42:07.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.747+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00732c0 con 0x7fbce80cdbc0 2023-08-25T09:42:07.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.748+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76e40aa010 con 0x7f76ec039cc0 2023-08-25T09:42:07.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.748+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44005250 con 0x7faa5c0b8b00 2023-08-25T09:42:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.748+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd0005250 con 0x7fbce80cdbc0 2023-08-25T09:42:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.749+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa5800c940 con 0x7faa5c0b8b00 2023-08-25T09:42:07.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.749+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1394054240 con 0x7f13a406f4e0 2023-08-25T09:42:07.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.750+0000 7faa527fc640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7faa4006a050 0x7faa4006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.750+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbcf008f070 con 0x7fbce80cdbc0 2023-08-25T09:42:07.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.750+0000 7faa61888640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7faa4006a050 0x7faa4006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.750+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa58057990 con 0x7faa5c0b8b00 2023-08-25T09:42:07.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.750+0000 7fbcd77fe640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbcdc06a080 0x7fbcdc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:07.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.751+0000 7faa61888640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7faa4006a050 0x7faa4006c510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa54003f40 tx=0x7faa540091b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.751+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcf01017e0 con 0x7fbce80cdbc0 2023-08-25T09:42:07.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.751+0000 7fbceed9d640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbcdc06a080 0x7fbcdc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:07.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.752+0000 7fbceed9d640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbcdc06a080 0x7fbcdc06c540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbce002e170 tx=0x7fbce0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:07.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.753+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f76e40dc990 con 0x7f76ec039cc0 2023-08-25T09:42:07.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.760+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faa58053cd0 con 0x7faa5c0b8b00 2023-08-25T09:42:07.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:07.769+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbcf00d0b80 con 0x7fbce80cdbc0 2023-08-25T09:42:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.089+0000 7f458b512640 1 -- 172.21.15.89:0/825601549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4564005500 con 0x7f45840b8490 2023-08-25T09:42:08.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.090+0000 7f4579ffb640 1 -- 172.21.15.89:0/825601549 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f457c018030 con 0x7f45840b8490 2023-08-25T09:42:08.095 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:08.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 -- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f456806a170 msgr2=0x7f456806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f456806a170 0x7f456806c630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4580034000 tx=0x7f4580008030 comp rx=0 tx=0).stop 2023-08-25T09:42:08.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 -- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 msgr2=0x7f458413b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f458413b870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f457c00caf0 tx=0x7f457c002170 comp rx=0 tx=0).stop 2023-08-25T09:42:08.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 -- 172.21.15.89:0/825601549 shutdown_connections 2023-08-25T09:42:08.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f456806a170 0x7f456806c630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f458414a1b0 0x7f4584154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4584140c40 0x7f45840bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 --2- 172.21.15.89:0/825601549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45840b8490 0x7f458413b870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 -- 172.21.15.89:0/825601549 >> 172.21.15.89:0/825601549 conn(0x7f45840bbe70 msgr2=0x7f458413e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 -- 172.21.15.89:0/825601549 shutdown_connections 2023-08-25T09:42:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.093+0000 7f456f7fe640 1 -- 172.21.15.89:0/825601549 wait complete. 2023-08-25T09:42:08.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-08-25T09:42:08.111 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.122+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37e40b7dc0 con 0x7f37e40bc960 2023-08-25T09:42:08.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.122+0000 7f37cbfff640 1 -- 172.21.15.89:0/2051322713 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37d80574e0 con 0x7f37e40bc960 2023-08-25T09:42:08.125 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-08-25T09:42:08.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.124+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37d006a080 msgr2=0x7f37d006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.124+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37d006a080 0x7f37d006c540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37dc039000 tx=0x7f37dc034000 comp rx=0 tx=0).stop 2023-08-25T09:42:08.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.124+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 msgr2=0x7f37e4148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.124+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 0x7f37e4148eb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37d800e980 tx=0x7f37d800ee40 comp rx=0 tx=0).stop 2023-08-25T09:42:08.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 shutdown_connections 2023-08-25T09:42:08.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37d006a080 0x7f37d006c540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e40bc960 0x7f37e4148eb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37e4140c40 0x7f37e4135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 --2- 172.21.15.89:0/2051322713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37e40b8490 0x7f37e4147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 >> 172.21.15.89:0/2051322713 conn(0x7f37e40bbe70 msgr2=0x7f37e413e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 shutdown_connections 2023-08-25T09:42:08.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.125+0000 7f37e9bbc640 1 -- 172.21.15.89:0/2051322713 wait complete. 2023-08-25T09:42:08.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-08-25T09:42:08.140 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.140+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc21814ab40 con 0x7fc2180bc960 2023-08-25T09:42:08.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.140+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13a404dbd0 con 0x7f13a406f4e0 2023-08-25T09:42:08.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.140+0000 7fc20e7fc640 1 -- 172.21.15.89:0/4053040787 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc214056830 con 0x7fc2180bc960 2023-08-25T09:42:08.143 INFO:teuthology.orchestra.run.smithi089.stdout:55834574853 2023-08-25T09:42:08.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.140+0000 7f13a17fa640 1 -- 172.21.15.89:0/3756839331 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1394057860 con 0x7f13a406f4e0 2023-08-25T09:42:08.144 INFO:teuthology.orchestra.run.smithi089.stdout:55834574854 2023-08-25T09:42:08.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.142+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7b100057d0 con 0x7f7b3014a1b0 2023-08-25T09:42:08.145 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-08-25T09:42:08.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.142+0000 7f7b25ffb640 1 -- 172.21.15.89:0/3311287112 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b20017020 con 0x7f7b3014a1b0 2023-08-25T09:42:08.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f139006a0d0 msgr2=0x7f139006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f139006a0d0 0x7f139006c590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1398036000 tx=0x7f139803c040 comp rx=0 tx=0).stop 2023-08-25T09:42:08.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 msgr2=0x7f13a4152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 0x7f13a4152600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f139400e9e0 tx=0x7f139400eea0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 shutdown_connections 2023-08-25T09:42:08.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f139006a0d0 0x7f139006c590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13a4146140 0x7f13a4152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13a406f4e0 0x7f13a4152600 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 --2- 172.21.15.89:0/3756839331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13a406ea80 0x7f13a41508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 >> 172.21.15.89:0/3756839331 conn(0x7f13a40bbe70 msgr2=0x7f13a40b9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 shutdown_connections 2023-08-25T09:42:08.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1fc06a0a0 msgr2=0x7fc1fc06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1fc06a0a0 0x7fc1fc06c560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc210036000 tx=0x7fc210030000 comp rx=0 tx=0).stop 2023-08-25T09:42:08.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 msgr2=0x7fc2180baf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 0x7fc2180baf10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c400 tx=0x7fc21400c8c0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 shutdown_connections 2023-08-25T09:42:08.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc1fc06a0a0 0x7fc1fc06c560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc218140c40 0x7fc2181decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2180bc960 0x7fc2180baf10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 --2- 172.21.15.89:0/4053040787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2180b8490 0x7fc218148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 >> 172.21.15.89:0/4053040787 conn(0x7fc2180bbe70 msgr2=0x7fc21813a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7f13ab10c640 1 -- 172.21.15.89:0/3756839331 wait complete. 2023-08-25T09:42:08.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 shutdown_connections 2023-08-25T09:42:08.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.143+0000 7fc21fad9640 1 -- 172.21.15.89:0/4053040787 wait complete. 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b1406a050 msgr2=0x7f7b1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b1406a050 0x7f7b1406c510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c000f60 tx=0x7f7b2c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 msgr2=0x7f7b301386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 0x7f7b301386d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000c3c0 tx=0x7f7b2000c880 comp rx=0 tx=0).stop 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 shutdown_connections 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b1406a050 0x7f7b1406c510 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b3014a1b0 0x7f7b301386d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b30140c40 0x7f7b300b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 --2- 172.21.15.89:0/3311287112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b300b8490 0x7f7b301e73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 >> 172.21.15.89:0/3311287112 conn(0x7f7b300bbe70 msgr2=0x7f7b300b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 shutdown_connections 2023-08-25T09:42:08.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.145+0000 7f7b37846640 1 -- 172.21.15.89:0/3311287112 wait complete. 2023-08-25T09:42:08.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.151+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f76d8005500 con 0x7f76ec039cc0 2023-08-25T09:42:08.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.152+0000 7f76e2ffd640 1 -- 172.21.15.89:0/2211914276 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76e4040090 con 0x7f76ec039cc0 2023-08-25T09:42:08.154 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:08.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbcd00057d0 con 0x7fbce80cdbc0 2023-08-25T09:42:08.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f76d406a020 msgr2=0x7f76d406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f76d406a020 0x7f76d406c4e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76f4067ec0 tx=0x7f76f40689c0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7fbcd77fe640 1 -- 172.21.15.89:0/189986286 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcf00d0710 con 0x7fbce80cdbc0 2023-08-25T09:42:08.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76ec039cc0 msgr2=0x7f76ec025800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76ec039cc0 0x7f76ec025800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0d0c20 tx=0x7f76e40046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.159 INFO:teuthology.orchestra.run.smithi089.stdout:55834574856 2023-08-25T09:42:08.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 shutdown_connections 2023-08-25T09:42:08.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f76d406a020 0x7f76d406c4e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76ec0d04e0 0x7f76ec023ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76ec039cc0 0x7f76ec025800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 --2- 172.21.15.89:0/2211914276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec007140 0x7f76ec026a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 >> 172.21.15.89:0/2211914276 conn(0x7f76ec03ee50 msgr2=0x7f76ec0cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.154+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 shutdown_connections 2023-08-25T09:42:08.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.155+0000 7f76f8fab640 1 -- 172.21.15.89:0/2211914276 wait complete. 2023-08-25T09:42:08.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbcdc06a080 msgr2=0x7fbcdc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbcdc06a080 0x7fbcdc06c540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbce002e170 tx=0x7fbce0032000 comp rx=0 tx=0).stop 2023-08-25T09:42:08.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce80cdbc0 msgr2=0x7fbce803aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce80cdbc0 0x7fbce803aa70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbcf004e980 tx=0x7fbcf0066bd0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 shutdown_connections 2023-08-25T09:42:08.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbcdc06a080 0x7fbcdc06c540 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbce80cdbc0 0x7fbce803aa70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce803e0d0 0x7fbce8039ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 --2- 172.21.15.89:0/189986286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce8037f10 0x7fbce8033e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 >> 172.21.15.89:0/189986286 conn(0x7fbce803ee50 msgr2=0x7fbce80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 shutdown_connections 2023-08-25T09:42:08.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.157+0000 7fbcf5034640 1 -- 172.21.15.89:0/189986286 wait complete. 2023-08-25T09:42:08.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.162+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa44005500 con 0x7faa5c0b8b00 2023-08-25T09:42:08.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.162+0000 7faa527fc640 1 -- 172.21.15.89:0/2264233288 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa58017090 con 0x7faa5c0b8b00 2023-08-25T09:42:08.165 INFO:teuthology.orchestra.run.smithi089.stdout:55834574855 2023-08-25T09:42:08.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-08-25T09:42:08.167 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-25T09:42:08.168 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-08-25T09:42:08.170 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7faa4006a050 msgr2=0x7faa4006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.170 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7faa4006a050 0x7faa4006c510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa54003f40 tx=0x7faa540091b0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 msgr2=0x7faa5c0bc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 0x7faa5c0bc890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa5800e870 tx=0x7faa5800ed30 comp rx=0 tx=0).stop 2023-08-25T09:42:08.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 shutdown_connections 2023-08-25T09:42:08.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7faa4006a050 0x7faa4006c510 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa5c0b8b00 0x7faa5c0bc890 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.171 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa5c14c120 0x7faa5c149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 --2- 172.21.15.89:0/2264233288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa5c071570 0x7faa5c1368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 >> 172.21.15.89:0/2264233288 conn(0x7faa5c069850 msgr2=0x7faa5c0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 shutdown_connections 2023-08-25T09:42:08.172 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.164+0000 7faa6288a640 1 -- 172.21.15.89:0/2264233288 wait complete. 2023-08-25T09:42:08.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-08-25T09:42:08.173 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-08-25T09:42:08.174 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-08-25T09:42:08.178 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:08.178 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-25T09:42:08.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:08.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.315+0000 7fa933b24640 1 Processor -- start 2023-08-25T09:42:08.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.315+0000 7fa933b24640 1 -- start start 2023-08-25T09:42:08.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa933b24640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa92c0b9a10 0x7fa92c14a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa933b24640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c14de90 con 0x7fa92c0b9ea0 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa933b24640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c0b6e40 con 0x7fa92c0b6a60 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa933b24640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c14ea80 con 0x7fa92c0b9a10 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9320c1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa92c0b9ea0 0x7fa92c155220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55886/0 (socket says 172.21.15.89:55886) 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9320c1640 1 -- 172.21.15.89:0/2681548532 learned_addr learned my addr 172.21.15.89:0/2681548532 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9310bf640 1 --2- 172.21.15.89:0/2681548532 >> v2:172.21.15.121:3300/0 conn(0x7fa92c0b9a10 0x7fa92c14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839453023 0 0) 0x7fa92c14de90 con 0x7fa92c0b9ea0 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa918003520 con 0x7fa92c0b9ea0 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119883649 0 0) 0x7fa918003520 con 0x7fa92c0b9ea0 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 >> v2:172.21.15.121:3300/0 conn(0x7fa92c0b9a10 msgr2=0x7fa92c14a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 --2- 172.21.15.89:0/2681548532 >> v2:172.21.15.121:3300/0 conn(0x7fa92c0b9a10 0x7fa92c14a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 >> v1:172.21.15.121:6789/0 conn(0x7fa92c0b6a60 legacy=0x7fa92c06fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0712d0 con 0x7fa92c0b9ea0 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fa9240019f0 con 0x7fa92c0b9ea0 2023-08-25T09:42:08.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 >> v1:172.21.15.89:6789/0 conn(0x7fa92c0b9ea0 legacy=0x7fa92c155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9180039e0 0x7fa918003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9180047c0 0x7fa918004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa91800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c14ea80 con 0x7fa918005180 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91800c0b0 con 0x7fa9180047c0 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91800c270 con 0x7fa9180039e0 2023-08-25T09:42:08.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9320c1640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa91800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9310bf640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9180047c0 0x7fa918004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.316+0000 7fa9318c0640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9180039e0 0x7fa918003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 -- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9180039e0 msgr2=0x7fa918003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9180039e0 0x7fa918003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 -- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9180047c0 msgr2=0x7fa918004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9180047c0 0x7fa918004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 -- 172.21.15.89:0/2681548532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa918003520 con 0x7fa918005180 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9318c0640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9180039e0 0x7fa918003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 -- 172.21.15.89:0/2681548532 reap_dead start 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.317+0000 7fa9320c1640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa91800b980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa92400a830 tx=0x7fa9180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d163d3009f8fd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240072d0 con 0x7fa918005180 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92402f070 con 0x7fa918005180 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa9308be640 1 -- 172.21.15.89:0/2681548532 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240076b0 con 0x7fa918005180 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 -- 172.21.15.89:0/2681548532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 msgr2=0x7fa91800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.325 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa91800b980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa92400a830 tx=0x7fa9180057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 -- 172.21.15.89:0/2681548532 shutdown_connections 2023-08-25T09:42:08.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 --2- 172.21.15.89:0/2681548532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa91800b980 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 -- 172.21.15.89:0/2681548532 >> 172.21.15.89:0/2681548532 conn(0x7fa92c0bcfa0 msgr2=0x7fa92c0bd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 -- 172.21.15.89:0/2681548532 shutdown_connections 2023-08-25T09:42:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.318+0000 7fa933b24640 1 -- 172.21.15.89:0/2681548532 wait complete. 2023-08-25T09:42:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.319+0000 7fa933b24640 1 Processor -- start 2023-08-25T09:42:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.319+0000 7fa933b24640 1 -- start start 2023-08-25T09:42:08.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa92c1453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92c147a40 0x7fa92c1df790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa92c1dfcd0 0x7fa92c141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1458e0 con 0x7fa918005180 2023-08-25T09:42:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c14d7b0 con 0x7fa92c147a40 2023-08-25T09:42:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1465b0 con 0x7fa92c1dfcd0 2023-08-25T09:42:08.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa92c1453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa92c1453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59814/0 (socket says 172.21.15.89:59814) 2023-08-25T09:42:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 -- 172.21.15.89:0/2607562947 learned_addr learned my addr 172.21.15.89:0/2607562947 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9310bf640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92c147a40 0x7fa92c1df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9320c1640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa92c1dfcd0 0x7fa92c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 -- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa92c1dfcd0 msgr2=0x7fa92c141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa92c1dfcd0 0x7fa92c141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 -- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92c147a40 msgr2=0x7fa92c1df790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92c147a40 0x7fa92c1df790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 -- 172.21.15.89:0/2607562947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c14d4d0 con 0x7fa918005180 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9318c0640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa92c1453a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa928000c00 tx=0x7fa92800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9280052e0 con 0x7fa918005180 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928005440 con 0x7fa918005180 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c146850 con 0x7fa918005180 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928003830 con 0x7fa918005180 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.320+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c145ab0 con 0x7fa918005180 2023-08-25T09:42:08.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.321+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c146410 con 0x7fa918005180 2023-08-25T09:42:08.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.322+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa928003990 con 0x7fa918005180 2023-08-25T09:42:08.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.322+0000 7fa9227fc640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa91006a080 0x7fa91006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.322+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa928087be0 con 0x7fa918005180 2023-08-25T09:42:08.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.322+0000 7fa9310bf640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa91006a080 0x7fa91006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.323+0000 7fa9310bf640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa91006a080 0x7fa91006c540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa92c14d400 tx=0x7fa91c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.326+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa92c146410 con 0x7fa918005180 2023-08-25T09:42:08.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.489+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa92c145c40 con 0x7fa91006a080 2023-08-25T09:42:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.496+0000 7fa9227fc640 1 -- 172.21.15.89:0/2607562947 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286635 (secure 0 0 0) 0x7fa92c145c40 con 0x7fa91006a080 2023-08-25T09:42:08.501 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:08.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa91006a080 msgr2=0x7fa91006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa91006a080 0x7fa91006c540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa92c14d400 tx=0x7fa91c009190 comp rx=0 tx=0).stop 2023-08-25T09:42:08.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 msgr2=0x7fa92c1453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa92c1453a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa928000c00 tx=0x7fa92800e830 comp rx=0 tx=0).stop 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 shutdown_connections 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa91006a080 0x7fa91006c540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa92c1dfcd0 0x7fa92c141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa92c147a40 0x7fa92c1df790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 --2- 172.21.15.89:0/2607562947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa918005180 0x7fa92c1453a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 >> 172.21.15.89:0/2607562947 conn(0x7fa92c0bcfa0 msgr2=0x7fa92c0bc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 shutdown_connections 2023-08-25T09:42:08.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.500+0000 7fa933b24640 1 -- 172.21.15.89:0/2607562947 wait complete. 2023-08-25T09:42:08.513 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T09:42:06.500997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219300,"kb_used_data":3112,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755420,"statfs":{"total":773094113280,"available":772869550080,"internally_reserved":0,"allocated":3186688,"data_stored":1902348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.264509"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336246+0000","last_change":"2023-08-25T09:42:01.258799+0000","last_active":"2023-08-25T09:42:02.336246+0000","last_peered":"2023-08-25T09:42:02.336246+0000","last_clean":"2023-08-25T09:42:02.336246+0000","last_became_active":"2023-08-25T09:42:01.258539+0000","last_became_peered":"2023-08-25T09:42:01.258539+0000","last_unstale":"2023-08-25T09:42:02.336246+0000","last_undegraded":"2023-08-25T09:42:02.336246+0000","last_fullsized":"2023-08-25T09:42:02.336246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:12:38.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142643+0000","last_change":"2023-08-25T09:42:01.264542+0000","last_active":"2023-08-25T09:42:03.142643+0000","last_peered":"2023-08-25T09:42:03.142643+0000","last_clean":"2023-08-25T09:42:03.142643+0000","last_became_active":"2023-08-25T09:42:01.264347+0000","last_became_peered":"2023-08-25T09:42:01.264347+0000","last_unstale":"2023-08-25T09:42:03.142643+0000","last_undegraded":"2023-08-25T09:42:03.142643+0000","last_fullsized":"2023-08-25T09:42:03.142643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258291+0000","last_change":"2023-08-25T09:42:01.257154+0000","last_active":"2023-08-25T09:42:02.258291+0000","last_peered":"2023-08-25T09:42:02.258291+0000","last_clean":"2023-08-25T09:42:02.258291+0000","last_became_active":"2023-08-25T09:42:01.256873+0000","last_became_peered":"2023-08-25T09:42:01.256873+0000","last_unstale":"2023-08-25T09:42:02.258291+0000","last_undegraded":"2023-08-25T09:42:02.258291+0000","last_fullsized":"2023-08-25T09:42:02.258291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:51.558349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142554+0000","last_change":"2023-08-25T09:42:01.257367+0000","last_active":"2023-08-25T09:42:03.142554+0000","last_peered":"2023-08-25T09:42:03.142554+0000","last_clean":"2023-08-25T09:42:03.142554+0000","last_became_active":"2023-08-25T09:42:01.257057+0000","last_became_peered":"2023-08-25T09:42:01.257057+0000","last_unstale":"2023-08-25T09:42:03.142554+0000","last_undegraded":"2023-08-25T09:42:03.142554+0000","last_fullsized":"2023-08-25T09:42:03.142554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:05:40.940630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728702+0000","last_change":"2023-08-25T09:42:01.267922+0000","last_active":"2023-08-25T09:42:02.728702+0000","last_peered":"2023-08-25T09:42:02.728702+0000","last_clean":"2023-08-25T09:42:02.728702+0000","last_became_active":"2023-08-25T09:42:01.267659+0000","last_became_peered":"2023-08-25T09:42:01.267659+0000","last_unstale":"2023-08-25T09:42:02.728702+0000","last_undegraded":"2023-08-25T09:42:02.728702+0000","last_fullsized":"2023-08-25T09:42:02.728702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257835+0000","last_change":"2023-08-25T09:42:01.259471+0000","last_active":"2023-08-25T09:42:02.257835+0000","last_peered":"2023-08-25T09:42:02.257835+0000","last_clean":"2023-08-25T09:42:02.257835+0000","last_became_active":"2023-08-25T09:42:01.259153+0000","last_became_peered":"2023-08-25T09:42:01.259153+0000","last_unstale":"2023-08-25T09:42:02.257835+0000","last_undegraded":"2023-08-25T09:42:02.257835+0000","last_fullsized":"2023-08-25T09:42:02.257835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143444+0000","last_change":"2023-08-25T09:42:01.256881+0000","last_active":"2023-08-25T09:42:03.143444+0000","last_peered":"2023-08-25T09:42:03.143444+0000","last_clean":"2023-08-25T09:42:03.143444+0000","last_became_active":"2023-08-25T09:42:01.256614+0000","last_became_peered":"2023-08-25T09:42:01.256614+0000","last_unstale":"2023-08-25T09:42:03.143444+0000","last_undegraded":"2023-08-25T09:42:03.143444+0000","last_fullsized":"2023-08-25T09:42:03.143444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:51.558349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142267+0000","last_change":"2023-08-25T09:42:01.254639+0000","last_active":"2023-08-25T09:42:03.142267+0000","last_peered":"2023-08-25T09:42:03.142267+0000","last_clean":"2023-08-25T09:42:03.142267+0000","last_became_active":"2023-08-25T09:42:01.254372+0000","last_became_peered":"2023-08-25T09:42:01.254372+0000","last_unstale":"2023-08-25T09:42:03.142267+0000","last_undegraded":"2023-08-25T09:42:03.142267+0000","last_fullsized":"2023-08-25T09:42:03.142267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728688+0000","last_change":"2023-08-25T09:42:01.267841+0000","last_active":"2023-08-25T09:42:02.728688+0000","last_peered":"2023-08-25T09:42:02.728688+0000","last_clean":"2023-08-25T09:42:02.728688+0000","last_became_active":"2023-08-25T09:42:01.267577+0000","last_became_peered":"2023-08-25T09:42:01.267577+0000","last_unstale":"2023-08-25T09:42:02.728688+0000","last_undegraded":"2023-08-25T09:42:02.728688+0000","last_fullsized":"2023-08-25T09:42:02.728688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:00.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142787+0000","last_change":"2023-08-25T09:42:01.261973+0000","last_active":"2023-08-25T09:42:03.142787+0000","last_peered":"2023-08-25T09:42:03.142787+0000","last_clean":"2023-08-25T09:42:03.142787+0000","last_became_active":"2023-08-25T09:42:01.261680+0000","last_became_peered":"2023-08-25T09:42:01.261680+0000","last_unstale":"2023-08-25T09:42:03.142787+0000","last_undegraded":"2023-08-25T09:42:03.142787+0000","last_fullsized":"2023-08-25T09:42:03.142787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258455+0000","last_change":"2023-08-25T09:42:01.259665+0000","last_active":"2023-08-25T09:42:02.258455+0000","last_peered":"2023-08-25T09:42:02.258455+0000","last_clean":"2023-08-25T09:42:02.258455+0000","last_became_active":"2023-08-25T09:42:01.258452+0000","last_became_peered":"2023-08-25T09:42:01.258452+0000","last_unstale":"2023-08-25T09:42:02.258455+0000","last_undegraded":"2023-08-25T09:42:02.258455+0000","last_fullsized":"2023-08-25T09:42:02.258455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:22:27.508892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336194+0000","last_change":"2023-08-25T09:42:01.252618+0000","last_active":"2023-08-25T09:42:02.336194+0000","last_peered":"2023-08-25T09:42:02.336194+0000","last_clean":"2023-08-25T09:42:02.336194+0000","last_became_active":"2023-08-25T09:42:01.252376+0000","last_became_peered":"2023-08-25T09:42:01.252376+0000","last_unstale":"2023-08-25T09:42:02.336194+0000","last_undegraded":"2023-08-25T09:42:02.336194+0000","last_fullsized":"2023-08-25T09:42:02.336194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:19:44.292634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336119+0000","last_change":"2023-08-25T09:42:01.262167+0000","last_active":"2023-08-25T09:42:02.336119+0000","last_peered":"2023-08-25T09:42:02.336119+0000","last_clean":"2023-08-25T09:42:02.336119+0000","last_became_active":"2023-08-25T09:42:01.261920+0000","last_became_peered":"2023-08-25T09:42:01.261920+0000","last_unstale":"2023-08-25T09:42:02.336119+0000","last_undegraded":"2023-08-25T09:42:02.336119+0000","last_fullsized":"2023-08-25T09:42:02.336119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:08:36.747182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142597+0000","last_change":"2023-08-25T09:42:01.260457+0000","last_active":"2023-08-25T09:42:03.142597+0000","last_peered":"2023-08-25T09:42:03.142597+0000","last_clean":"2023-08-25T09:42:03.142597+0000","last_became_active":"2023-08-25T09:42:01.260183+0000","last_became_peered":"2023-08-25T09:42:01.260183+0000","last_unstale":"2023-08-25T09:42:03.142597+0000","last_undegraded":"2023-08-25T09:42:03.142597+0000","last_fullsized":"2023-08-25T09:42:03.142597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143571+0000","last_change":"2023-08-25T09:42:01.259993+0000","last_active":"2023-08-25T09:42:03.143571+0000","last_peered":"2023-08-25T09:42:03.143571+0000","last_clean":"2023-08-25T09:42:03.143571+0000","last_became_active":"2023-08-25T09:42:01.259579+0000","last_became_peered":"2023-08-25T09:42:01.259579+0000","last_unstale":"2023-08-25T09:42:03.143571+0000","last_undegraded":"2023-08-25T09:42:03.143571+0000","last_fullsized":"2023-08-25T09:42:03.143571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:05.612344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257642+0000","last_change":"2023-08-25T09:42:01.257372+0000","last_active":"2023-08-25T09:42:02.257642+0000","last_peered":"2023-08-25T09:42:02.257642+0000","last_clean":"2023-08-25T09:42:02.257642+0000","last_became_active":"2023-08-25T09:42:01.257077+0000","last_became_peered":"2023-08-25T09:42:01.257077+0000","last_unstale":"2023-08-25T09:42:02.257642+0000","last_undegraded":"2023-08-25T09:42:02.257642+0000","last_fullsized":"2023-08-25T09:42:02.257642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728745+0000","last_change":"2023-08-25T09:42:01.267837+0000","last_active":"2023-08-25T09:42:02.728745+0000","last_peered":"2023-08-25T09:42:02.728745+0000","last_clean":"2023-08-25T09:42:02.728745+0000","last_became_active":"2023-08-25T09:42:01.267563+0000","last_became_peered":"2023-08-25T09:42:01.267563+0000","last_unstale":"2023-08-25T09:42:02.728745+0000","last_undegraded":"2023-08-25T09:42:02.728745+0000","last_fullsized":"2023-08-25T09:42:02.728745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258405+0000","last_change":"2023-08-25T09:42:01.251722+0000","last_active":"2023-08-25T09:42:02.258405+0000","last_peered":"2023-08-25T09:42:02.258405+0000","last_clean":"2023-08-25T09:42:02.258405+0000","last_became_active":"2023-08-25T09:42:01.251444+0000","last_became_peered":"2023-08-25T09:42:01.251444+0000","last_unstale":"2023-08-25T09:42:02.258405+0000","last_undegraded":"2023-08-25T09:42:02.258405+0000","last_fullsized":"2023-08-25T09:42:02.258405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:50.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336188+0000","last_change":"2023-08-25T09:42:01.256422+0000","last_active":"2023-08-25T09:42:02.336188+0000","last_peered":"2023-08-25T09:42:02.336188+0000","last_clean":"2023-08-25T09:42:02.336188+0000","last_became_active":"2023-08-25T09:42:01.256143+0000","last_became_peered":"2023-08-25T09:42:01.256143+0000","last_unstale":"2023-08-25T09:42:02.336188+0000","last_undegraded":"2023-08-25T09:42:02.336188+0000","last_fullsized":"2023-08-25T09:42:02.336188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:42:37.275739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258100+0000","last_change":"2023-08-25T09:42:01.254888+0000","last_active":"2023-08-25T09:42:02.258100+0000","last_peered":"2023-08-25T09:42:02.258100+0000","last_clean":"2023-08-25T09:42:02.258100+0000","last_became_active":"2023-08-25T09:42:01.254618+0000","last_became_peered":"2023-08-25T09:42:01.254618+0000","last_unstale":"2023-08-25T09:42:02.258100+0000","last_undegraded":"2023-08-25T09:42:02.258100+0000","last_fullsized":"2023-08-25T09:42:02.258100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143782+0000","last_change":"2023-08-25T09:42:01.262256+0000","last_active":"2023-08-25T09:42:03.143782+0000","last_peered":"2023-08-25T09:42:03.143782+0000","last_clean":"2023-08-25T09:42:03.143782+0000","last_became_active":"2023-08-25T09:42:01.261965+0000","last_became_peered":"2023-08-25T09:42:01.261965+0000","last_unstale":"2023-08-25T09:42:03.143782+0000","last_undegraded":"2023-08-25T09:42:03.143782+0000","last_fullsized":"2023-08-25T09:42:03.143782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:15.095999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728348+0000","last_change":"2023-08-25T09:42:01.265542+0000","last_active":"2023-08-25T09:42:02.728348+0000","last_peered":"2023-08-25T09:42:02.728348+0000","last_clean":"2023-08-25T09:42:02.728348+0000","last_became_active":"2023-08-25T09:42:01.265296+0000","last_became_peered":"2023-08-25T09:42:01.265296+0000","last_unstale":"2023-08-25T09:42:02.728348+0000","last_undegraded":"2023-08-25T09:42:02.728348+0000","last_fullsized":"2023-08-25T09:42:02.728348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253971+0000","last_change":"2023-08-25T09:42:01.263034+0000","last_active":"2023-08-25T09:42:02.253971+0000","last_peered":"2023-08-25T09:42:02.253971+0000","last_clean":"2023-08-25T09:42:02.253971+0000","last_became_active":"2023-08-25T09:42:01.262773+0000","last_became_peered":"2023-08-25T09:42:01.262773+0000","last_unstale":"2023-08-25T09:42:02.253971+0000","last_undegraded":"2023-08-25T09:42:02.253971+0000","last_fullsized":"2023-08-25T09:42:02.253971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143207+0000","last_change":"2023-08-25T09:42:01.258737+0000","last_active":"2023-08-25T09:42:03.143207+0000","last_peered":"2023-08-25T09:42:03.143207+0000","last_clean":"2023-08-25T09:42:03.143207+0000","last_became_active":"2023-08-25T09:42:01.258445+0000","last_became_peered":"2023-08-25T09:42:01.258445+0000","last_unstale":"2023-08-25T09:42:03.143207+0000","last_undegraded":"2023-08-25T09:42:03.143207+0000","last_fullsized":"2023-08-25T09:42:03.143207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142419+0000","last_change":"2023-08-25T09:42:01.268325+0000","last_active":"2023-08-25T09:42:03.142419+0000","last_peered":"2023-08-25T09:42:03.142419+0000","last_clean":"2023-08-25T09:42:03.142419+0000","last_became_active":"2023-08-25T09:42:01.268052+0000","last_became_peered":"2023-08-25T09:42:01.268052+0000","last_unstale":"2023-08-25T09:42:03.142419+0000","last_undegraded":"2023-08-25T09:42:03.142419+0000","last_fullsized":"2023-08-25T09:42:03.142419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142567+0000","last_change":"2023-08-25T09:42:01.265227+0000","last_active":"2023-08-25T09:42:03.142567+0000","last_peered":"2023-08-25T09:42:03.142567+0000","last_clean":"2023-08-25T09:42:03.142567+0000","last_became_active":"2023-08-25T09:42:01.264910+0000","last_became_peered":"2023-08-25T09:42:01.264910+0000","last_unstale":"2023-08-25T09:42:03.142567+0000","last_undegraded":"2023-08-25T09:42:03.142567+0000","last_fullsized":"2023-08-25T09:42:03.142567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142676+0000","last_change":"2023-08-25T09:42:01.260658+0000","last_active":"2023-08-25T09:42:03.142676+0000","last_peered":"2023-08-25T09:42:03.142676+0000","last_clean":"2023-08-25T09:42:03.142676+0000","last_became_active":"2023-08-25T09:42:01.260393+0000","last_became_peered":"2023-08-25T09:42:01.260393+0000","last_unstale":"2023-08-25T09:42:03.142676+0000","last_undegraded":"2023-08-25T09:42:03.142676+0000","last_fullsized":"2023-08-25T09:42:03.142676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142579+0000","last_change":"2023-08-25T09:42:01.262364+0000","last_active":"2023-08-25T09:42:03.142579+0000","last_peered":"2023-08-25T09:42:03.142579+0000","last_clean":"2023-08-25T09:42:03.142579+0000","last_became_active":"2023-08-25T09:42:01.261630+0000","last_became_peered":"2023-08-25T09:42:01.261630+0000","last_unstale":"2023-08-25T09:42:03.142579+0000","last_undegraded":"2023-08-25T09:42:03.142579+0000","last_fullsized":"2023-08-25T09:42:03.142579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:29.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254397+0000","last_change":"2023-08-25T09:42:01.263704+0000","last_active":"2023-08-25T09:42:02.254397+0000","last_peered":"2023-08-25T09:42:02.254397+0000","last_clean":"2023-08-25T09:42:02.254397+0000","last_became_active":"2023-08-25T09:42:01.263194+0000","last_became_peered":"2023-08-25T09:42:01.263194+0000","last_unstale":"2023-08-25T09:42:02.254397+0000","last_undegraded":"2023-08-25T09:42:02.254397+0000","last_fullsized":"2023-08-25T09:42:02.254397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:04.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258087+0000","last_change":"2023-08-25T09:42:01.256034+0000","last_active":"2023-08-25T09:42:02.258087+0000","last_peered":"2023-08-25T09:42:02.258087+0000","last_clean":"2023-08-25T09:42:02.258087+0000","last_became_active":"2023-08-25T09:42:01.255754+0000","last_became_peered":"2023-08-25T09:42:01.255754+0000","last_unstale":"2023-08-25T09:42:02.258087+0000","last_undegraded":"2023-08-25T09:42:02.258087+0000","last_fullsized":"2023-08-25T09:42:02.258087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253974+0000","last_change":"2023-08-25T09:42:01.265526+0000","last_active":"2023-08-25T09:42:02.253974+0000","last_peered":"2023-08-25T09:42:02.253974+0000","last_clean":"2023-08-25T09:42:02.253974+0000","last_became_active":"2023-08-25T09:42:01.265261+0000","last_became_peered":"2023-08-25T09:42:01.265261+0000","last_unstale":"2023-08-25T09:42:02.253974+0000","last_undegraded":"2023-08-25T09:42:02.253974+0000","last_fullsized":"2023-08-25T09:42:02.253974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:31.931382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142922+0000","last_change":"2023-08-25T09:42:01.255047+0000","last_active":"2023-08-25T09:42:03.142922+0000","last_peered":"2023-08-25T09:42:03.142922+0000","last_clean":"2023-08-25T09:42:03.142922+0000","last_became_active":"2023-08-25T09:42:01.254784+0000","last_became_peered":"2023-08-25T09:42:01.254784+0000","last_unstale":"2023-08-25T09:42:03.142922+0000","last_undegraded":"2023-08-25T09:42:03.142922+0000","last_fullsized":"2023-08-25T09:42:03.142922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:46:38.947826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254200+0000","last_change":"2023-08-25T09:42:01.265446+0000","last_active":"2023-08-25T09:42:02.254200+0000","last_peered":"2023-08-25T09:42:02.254200+0000","last_clean":"2023-08-25T09:42:02.254200+0000","last_became_active":"2023-08-25T09:42:01.265198+0000","last_became_peered":"2023-08-25T09:42:01.265198+0000","last_unstale":"2023-08-25T09:42:02.254200+0000","last_undegraded":"2023-08-25T09:42:02.254200+0000","last_fullsized":"2023-08-25T09:42:02.254200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:00.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143462+0000","last_change":"2023-08-25T09:42:00.256713+0000","last_active":"2023-08-25T09:42:03.143462+0000","last_peered":"2023-08-25T09:42:03.143462+0000","last_clean":"2023-08-25T09:42:03.143462+0000","last_became_active":"2023-08-25T09:42:00.256481+0000","last_became_peered":"2023-08-25T09:42:00.256481+0000","last_unstale":"2023-08-25T09:42:03.143462+0000","last_undegraded":"2023-08-25T09:42:03.143462+0000","last_fullsized":"2023-08-25T09:42:03.143462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:49.462578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142835+0000","last_change":"2023-08-25T09:42:01.260370+0000","last_active":"2023-08-25T09:42:03.142835+0000","last_peered":"2023-08-25T09:42:03.142835+0000","last_clean":"2023-08-25T09:42:03.142835+0000","last_became_active":"2023-08-25T09:42:01.260045+0000","last_became_peered":"2023-08-25T09:42:01.260045+0000","last_unstale":"2023-08-25T09:42:03.142835+0000","last_undegraded":"2023-08-25T09:42:03.142835+0000","last_fullsized":"2023-08-25T09:42:03.142835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:29.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728456+0000","last_change":"2023-08-25T09:42:00.251152+0000","last_active":"2023-08-25T09:42:02.728456+0000","last_peered":"2023-08-25T09:42:02.728456+0000","last_clean":"2023-08-25T09:42:02.728456+0000","last_became_active":"2023-08-25T09:42:00.250252+0000","last_became_peered":"2023-08-25T09:42:00.250252+0000","last_unstale":"2023-08-25T09:42:02.728456+0000","last_undegraded":"2023-08-25T09:42:02.728456+0000","last_fullsized":"2023-08-25T09:42:02.728456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:30.927542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728763+0000","last_change":"2023-08-25T09:42:01.262193+0000","last_active":"2023-08-25T09:42:02.728763+0000","last_peered":"2023-08-25T09:42:02.728763+0000","last_clean":"2023-08-25T09:42:02.728763+0000","last_became_active":"2023-08-25T09:42:01.261925+0000","last_became_peered":"2023-08-25T09:42:01.261925+0000","last_unstale":"2023-08-25T09:42:02.728763+0000","last_undegraded":"2023-08-25T09:42:02.728763+0000","last_fullsized":"2023-08-25T09:42:02.728763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143738+0000","last_change":"2023-08-25T09:42:00.255617+0000","last_active":"2023-08-25T09:42:03.143738+0000","last_peered":"2023-08-25T09:42:03.143738+0000","last_clean":"2023-08-25T09:42:03.143738+0000","last_became_active":"2023-08-25T09:42:00.255346+0000","last_became_peered":"2023-08-25T09:42:00.255346+0000","last_unstale":"2023-08-25T09:42:03.143738+0000","last_undegraded":"2023-08-25T09:42:03.143738+0000","last_fullsized":"2023-08-25T09:42:03.143738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:28:09.575735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254340+0000","last_change":"2023-08-25T09:42:01.263525+0000","last_active":"2023-08-25T09:42:02.254340+0000","last_peered":"2023-08-25T09:42:02.254340+0000","last_clean":"2023-08-25T09:42:02.254340+0000","last_became_active":"2023-08-25T09:42:01.263253+0000","last_became_peered":"2023-08-25T09:42:01.263253+0000","last_unstale":"2023-08-25T09:42:02.254340+0000","last_undegraded":"2023-08-25T09:42:02.254340+0000","last_fullsized":"2023-08-25T09:42:02.254340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142980+0000","last_change":"2023-08-25T09:42:00.252199+0000","last_active":"2023-08-25T09:42:03.142980+0000","last_peered":"2023-08-25T09:42:03.142980+0000","last_clean":"2023-08-25T09:42:03.142980+0000","last_became_active":"2023-08-25T09:42:00.251908+0000","last_became_peered":"2023-08-25T09:42:00.251908+0000","last_unstale":"2023-08-25T09:42:03.142980+0000","last_undegraded":"2023-08-25T09:42:03.142980+0000","last_fullsized":"2023-08-25T09:42:03.142980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:18:22.265214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143678+0000","last_change":"2023-08-25T09:42:00.256827+0000","last_active":"2023-08-25T09:42:03.143678+0000","last_peered":"2023-08-25T09:42:03.143678+0000","last_clean":"2023-08-25T09:42:03.143678+0000","last_became_active":"2023-08-25T09:42:00.256436+0000","last_became_peered":"2023-08-25T09:42:00.256436+0000","last_unstale":"2023-08-25T09:42:03.143678+0000","last_undegraded":"2023-08-25T09:42:03.143678+0000","last_fullsized":"2023-08-25T09:42:03.143678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:22:26.505052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142699+0000","last_change":"2023-08-25T09:42:01.260979+0000","last_active":"2023-08-25T09:42:03.142699+0000","last_peered":"2023-08-25T09:42:03.142699+0000","last_clean":"2023-08-25T09:42:03.142699+0000","last_became_active":"2023-08-25T09:42:01.260705+0000","last_became_peered":"2023-08-25T09:42:01.260705+0000","last_unstale":"2023-08-25T09:42:03.142699+0000","last_undegraded":"2023-08-25T09:42:03.142699+0000","last_fullsized":"2023-08-25T09:42:03.142699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143702+0000","last_change":"2023-08-25T09:42:00.256188+0000","last_active":"2023-08-25T09:42:03.143702+0000","last_peered":"2023-08-25T09:42:03.143702+0000","last_clean":"2023-08-25T09:42:03.143702+0000","last_became_active":"2023-08-25T09:42:00.255900+0000","last_became_peered":"2023-08-25T09:42:00.255900+0000","last_unstale":"2023-08-25T09:42:03.143702+0000","last_undegraded":"2023-08-25T09:42:03.143702+0000","last_fullsized":"2023-08-25T09:42:03.143702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:48.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257639+0000","last_change":"2023-08-25T09:42:01.258783+0000","last_active":"2023-08-25T09:42:02.257639+0000","last_peered":"2023-08-25T09:42:02.257639+0000","last_clean":"2023-08-25T09:42:02.257639+0000","last_became_active":"2023-08-25T09:42:01.258514+0000","last_became_peered":"2023-08-25T09:42:01.258514+0000","last_unstale":"2023-08-25T09:42:02.257639+0000","last_undegraded":"2023-08-25T09:42:02.257639+0000","last_fullsized":"2023-08-25T09:42:02.257639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:31.931382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143793+0000","last_change":"2023-08-25T09:42:00.249887+0000","last_active":"2023-08-25T09:42:03.143793+0000","last_peered":"2023-08-25T09:42:03.143793+0000","last_clean":"2023-08-25T09:42:03.143793+0000","last_became_active":"2023-08-25T09:42:00.249627+0000","last_became_peered":"2023-08-25T09:42:00.249627+0000","last_unstale":"2023-08-25T09:42:03.143793+0000","last_undegraded":"2023-08-25T09:42:03.143793+0000","last_fullsized":"2023-08-25T09:42:03.143793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:49.105687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142518+0000","last_change":"2023-08-25T09:42:01.259557+0000","last_active":"2023-08-25T09:42:03.142518+0000","last_peered":"2023-08-25T09:42:03.142518+0000","last_clean":"2023-08-25T09:42:03.142518+0000","last_became_active":"2023-08-25T09:42:01.259321+0000","last_became_peered":"2023-08-25T09:42:01.259321+0000","last_unstale":"2023-08-25T09:42:03.142518+0000","last_undegraded":"2023-08-25T09:42:03.142518+0000","last_fullsized":"2023-08-25T09:42:03.142518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:09.837898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142922+0000","last_change":"2023-08-25T09:42:00.251160+0000","last_active":"2023-08-25T09:42:03.142922+0000","last_peered":"2023-08-25T09:42:03.142922+0000","last_clean":"2023-08-25T09:42:03.142922+0000","last_became_active":"2023-08-25T09:42:00.250732+0000","last_became_peered":"2023-08-25T09:42:00.250732+0000","last_unstale":"2023-08-25T09:42:03.142922+0000","last_undegraded":"2023-08-25T09:42:03.142922+0000","last_fullsized":"2023-08-25T09:42:03.142922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:50.554509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728542+0000","last_change":"2023-08-25T09:42:01.266242+0000","last_active":"2023-08-25T09:42:02.728542+0000","last_peered":"2023-08-25T09:42:02.728542+0000","last_clean":"2023-08-25T09:42:02.728542+0000","last_became_active":"2023-08-25T09:42:01.265828+0000","last_became_peered":"2023-08-25T09:42:01.265828+0000","last_unstale":"2023-08-25T09:42:02.728542+0000","last_undegraded":"2023-08-25T09:42:02.728542+0000","last_fullsized":"2023-08-25T09:42:02.728542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254592+0000","last_change":"2023-08-25T09:42:00.252308+0000","last_active":"2023-08-25T09:42:02.254592+0000","last_peered":"2023-08-25T09:42:02.254592+0000","last_clean":"2023-08-25T09:42:02.254592+0000","last_became_active":"2023-08-25T09:42:00.252073+0000","last_became_peered":"2023-08-25T09:42:00.252073+0000","last_unstale":"2023-08-25T09:42:02.254592+0000","last_undegraded":"2023-08-25T09:42:02.254592+0000","last_fullsized":"2023-08-25T09:42:02.254592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:50.554509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258145+0000","last_change":"2023-08-25T09:42:01.258889+0000","last_active":"2023-08-25T09:42:02.258145+0000","last_peered":"2023-08-25T09:42:02.258145+0000","last_clean":"2023-08-25T09:42:02.258145+0000","last_became_active":"2023-08-25T09:42:01.258615+0000","last_became_peered":"2023-08-25T09:42:01.258615+0000","last_unstale":"2023-08-25T09:42:02.258145+0000","last_undegraded":"2023-08-25T09:42:02.258145+0000","last_fullsized":"2023-08-25T09:42:02.258145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142731+0000","last_change":"2023-08-25T09:42:00.255638+0000","last_active":"2023-08-25T09:42:03.142731+0000","last_peered":"2023-08-25T09:42:03.142731+0000","last_clean":"2023-08-25T09:42:03.142731+0000","last_became_active":"2023-08-25T09:42:00.255344+0000","last_became_peered":"2023-08-25T09:42:00.255344+0000","last_unstale":"2023-08-25T09:42:03.142731+0000","last_undegraded":"2023-08-25T09:42:03.142731+0000","last_fullsized":"2023-08-25T09:42:03.142731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:27.471989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258465+0000","last_change":"2023-08-25T09:42:01.251560+0000","last_active":"2023-08-25T09:42:02.258465+0000","last_peered":"2023-08-25T09:42:02.258465+0000","last_clean":"2023-08-25T09:42:02.258465+0000","last_became_active":"2023-08-25T09:42:01.251268+0000","last_became_peered":"2023-08-25T09:42:01.251268+0000","last_unstale":"2023-08-25T09:42:02.258465+0000","last_undegraded":"2023-08-25T09:42:02.258465+0000","last_fullsized":"2023-08-25T09:42:02.258465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:49.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257907+0000","last_change":"2023-08-25T09:42:00.254661+0000","last_active":"2023-08-25T09:42:02.257907+0000","last_peered":"2023-08-25T09:42:02.257907+0000","last_clean":"2023-08-25T09:42:02.257907+0000","last_became_active":"2023-08-25T09:42:00.253381+0000","last_became_peered":"2023-08-25T09:42:00.253381+0000","last_unstale":"2023-08-25T09:42:02.257907+0000","last_undegraded":"2023-08-25T09:42:02.257907+0000","last_fullsized":"2023-08-25T09:42:02.257907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258437+0000","last_change":"2023-08-25T09:42:01.255458+0000","last_active":"2023-08-25T09:42:02.258437+0000","last_peered":"2023-08-25T09:42:02.258437+0000","last_clean":"2023-08-25T09:42:02.258437+0000","last_became_active":"2023-08-25T09:42:01.255174+0000","last_became_peered":"2023-08-25T09:42:01.255174+0000","last_unstale":"2023-08-25T09:42:02.258437+0000","last_undegraded":"2023-08-25T09:42:02.258437+0000","last_fullsized":"2023-08-25T09:42:02.258437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:31.891505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254199+0000","last_change":"2023-08-25T09:42:00.251897+0000","last_active":"2023-08-25T09:42:02.254199+0000","last_peered":"2023-08-25T09:42:02.254199+0000","last_clean":"2023-08-25T09:42:02.254199+0000","last_became_active":"2023-08-25T09:42:00.251637+0000","last_became_peered":"2023-08-25T09:42:00.251637+0000","last_unstale":"2023-08-25T09:42:02.254199+0000","last_undegraded":"2023-08-25T09:42:02.254199+0000","last_fullsized":"2023-08-25T09:42:02.254199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:05.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142473+0000","last_change":"2023-08-25T09:42:01.262069+0000","last_active":"2023-08-25T09:42:03.142473+0000","last_peered":"2023-08-25T09:42:03.142473+0000","last_clean":"2023-08-25T09:42:03.142473+0000","last_became_active":"2023-08-25T09:42:01.261830+0000","last_became_peered":"2023-08-25T09:42:01.261830+0000","last_unstale":"2023-08-25T09:42:03.142473+0000","last_undegraded":"2023-08-25T09:42:03.142473+0000","last_fullsized":"2023-08-25T09:42:03.142473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143814+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:03.143814+0000","last_peered":"2023-08-25T09:42:03.143814+0000","last_clean":"2023-08-25T09:42:03.143814+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:03.143814+0000","last_undegraded":"2023-08-25T09:42:03.143814+0000","last_fullsized":"2023-08-25T09:42:03.143814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:18:08.583532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142670+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:03.142670+0000","last_peered":"2023-08-25T09:42:03.142670+0000","last_clean":"2023-08-25T09:42:03.142670+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:03.142670+0000","last_undegraded":"2023-08-25T09:42:03.142670+0000","last_fullsized":"2023-08-25T09:42:03.142670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:59.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254092+0000","last_change":"2023-08-25T09:42:00.247378+0000","last_active":"2023-08-25T09:42:02.254092+0000","last_peered":"2023-08-25T09:42:02.254092+0000","last_clean":"2023-08-25T09:42:02.254092+0000","last_became_active":"2023-08-25T09:42:00.247122+0000","last_became_peered":"2023-08-25T09:42:00.247122+0000","last_unstale":"2023-08-25T09:42:02.254092+0000","last_undegraded":"2023-08-25T09:42:02.254092+0000","last_fullsized":"2023-08-25T09:42:02.254092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:28.310394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142498+0000","last_change":"2023-08-25T09:42:01.253735+0000","last_active":"2023-08-25T09:42:03.142498+0000","last_peered":"2023-08-25T09:42:03.142498+0000","last_clean":"2023-08-25T09:42:03.142498+0000","last_became_active":"2023-08-25T09:42:01.253398+0000","last_became_peered":"2023-08-25T09:42:01.253398+0000","last_unstale":"2023-08-25T09:42:03.142498+0000","last_undegraded":"2023-08-25T09:42:03.142498+0000","last_fullsized":"2023-08-25T09:42:03.142498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:17:00.671122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143237+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:03.143237+0000","last_peered":"2023-08-25T09:42:03.143237+0000","last_clean":"2023-08-25T09:42:03.143237+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:03.143237+0000","last_undegraded":"2023-08-25T09:42:03.143237+0000","last_fullsized":"2023-08-25T09:42:03.143237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:24.076968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728342+0000","last_change":"2023-08-25T09:42:00.257069+0000","last_active":"2023-08-25T09:42:02.728342+0000","last_peered":"2023-08-25T09:42:02.728342+0000","last_clean":"2023-08-25T09:42:02.728342+0000","last_became_active":"2023-08-25T09:42:00.256862+0000","last_became_peered":"2023-08-25T09:42:00.256862+0000","last_unstale":"2023-08-25T09:42:02.728342+0000","last_undegraded":"2023-08-25T09:42:02.728342+0000","last_fullsized":"2023-08-25T09:42:02.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:58:16.721689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728703+0000","last_change":"2023-08-25T09:42:01.266329+0000","last_active":"2023-08-25T09:42:02.728703+0000","last_peered":"2023-08-25T09:42:02.728703+0000","last_clean":"2023-08-25T09:42:02.728703+0000","last_became_active":"2023-08-25T09:42:01.266071+0000","last_became_peered":"2023-08-25T09:42:01.266071+0000","last_unstale":"2023-08-25T09:42:02.728703+0000","last_undegraded":"2023-08-25T09:42:02.728703+0000","last_fullsized":"2023-08-25T09:42:02.728703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336077+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:02.336077+0000","last_peered":"2023-08-25T09:42:02.336077+0000","last_clean":"2023-08-25T09:42:02.336077+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:02.336077+0000","last_undegraded":"2023-08-25T09:42:02.336077+0000","last_fullsized":"2023-08-25T09:42:02.336077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:35.544962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142102+0000","last_change":"2023-08-25T09:42:00.247602+0000","last_active":"2023-08-25T09:42:03.142102+0000","last_peered":"2023-08-25T09:42:03.142102+0000","last_clean":"2023-08-25T09:42:03.142102+0000","last_became_active":"2023-08-25T09:42:00.247328+0000","last_became_peered":"2023-08-25T09:42:00.247328+0000","last_unstale":"2023-08-25T09:42:03.142102+0000","last_undegraded":"2023-08-25T09:42:03.142102+0000","last_fullsized":"2023-08-25T09:42:03.142102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:01.555687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142554+0000","last_change":"2023-08-25T09:42:01.263095+0000","last_active":"2023-08-25T09:42:03.142554+0000","last_peered":"2023-08-25T09:42:03.142554+0000","last_clean":"2023-08-25T09:42:03.142554+0000","last_became_active":"2023-08-25T09:42:01.262854+0000","last_became_peered":"2023-08-25T09:42:01.262854+0000","last_unstale":"2023-08-25T09:42:03.142554+0000","last_undegraded":"2023-08-25T09:42:03.142554+0000","last_fullsized":"2023-08-25T09:42:03.142554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:04.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142511+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:03.142511+0000","last_peered":"2023-08-25T09:42:03.142511+0000","last_clean":"2023-08-25T09:42:03.142511+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:03.142511+0000","last_undegraded":"2023-08-25T09:42:03.142511+0000","last_fullsized":"2023-08-25T09:42:03.142511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:38.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258246+0000","last_change":"2023-08-25T09:42:00.256819+0000","last_active":"2023-08-25T09:42:02.258246+0000","last_peered":"2023-08-25T09:42:02.258246+0000","last_clean":"2023-08-25T09:42:02.258246+0000","last_became_active":"2023-08-25T09:42:00.254689+0000","last_became_peered":"2023-08-25T09:42:00.254689+0000","last_unstale":"2023-08-25T09:42:02.258246+0000","last_undegraded":"2023-08-25T09:42:02.258246+0000","last_fullsized":"2023-08-25T09:42:02.258246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142413+0000","last_change":"2023-08-25T09:42:01.268038+0000","last_active":"2023-08-25T09:42:03.142413+0000","last_peered":"2023-08-25T09:42:03.142413+0000","last_clean":"2023-08-25T09:42:03.142413+0000","last_became_active":"2023-08-25T09:42:01.267785+0000","last_became_peered":"2023-08-25T09:42:01.267785+0000","last_unstale":"2023-08-25T09:42:03.142413+0000","last_undegraded":"2023-08-25T09:42:03.142413+0000","last_fullsized":"2023-08-25T09:42:03.142413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143095+0000","last_change":"2023-08-25T09:42:00.246654+0000","last_active":"2023-08-25T09:42:03.143095+0000","last_peered":"2023-08-25T09:42:03.143095+0000","last_clean":"2023-08-25T09:42:03.143095+0000","last_became_active":"2023-08-25T09:42:00.245171+0000","last_became_peered":"2023-08-25T09:42:00.245171+0000","last_unstale":"2023-08-25T09:42:03.143095+0000","last_undegraded":"2023-08-25T09:42:03.143095+0000","last_fullsized":"2023-08-25T09:42:03.143095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:04.608504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142537+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:03.142537+0000","last_peered":"2023-08-25T09:42:03.142537+0000","last_clean":"2023-08-25T09:42:03.142537+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:03.142537+0000","last_undegraded":"2023-08-25T09:42:03.142537+0000","last_fullsized":"2023-08-25T09:42:03.142537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:53.280406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142329+0000","last_change":"2023-08-25T09:42:01.262457+0000","last_active":"2023-08-25T09:42:03.142329+0000","last_peered":"2023-08-25T09:42:03.142329+0000","last_clean":"2023-08-25T09:42:03.142329+0000","last_became_active":"2023-08-25T09:42:01.262194+0000","last_became_peered":"2023-08-25T09:42:01.262194+0000","last_unstale":"2023-08-25T09:42:03.142329+0000","last_undegraded":"2023-08-25T09:42:03.142329+0000","last_fullsized":"2023-08-25T09:42:03.142329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142388+0000","last_change":"2023-08-25T09:42:00.247634+0000","last_active":"2023-08-25T09:42:03.142388+0000","last_peered":"2023-08-25T09:42:03.142388+0000","last_clean":"2023-08-25T09:42:03.142388+0000","last_became_active":"2023-08-25T09:42:00.247346+0000","last_became_peered":"2023-08-25T09:42:00.247346+0000","last_unstale":"2023-08-25T09:42:03.142388+0000","last_undegraded":"2023-08-25T09:42:03.142388+0000","last_fullsized":"2023-08-25T09:42:03.142388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143903+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:03.143903+0000","last_peered":"2023-08-25T09:42:03.143903+0000","last_clean":"2023-08-25T09:42:03.143903+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:03.143903+0000","last_undegraded":"2023-08-25T09:42:03.143903+0000","last_fullsized":"2023-08-25T09:42:03.143903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:03:50.781902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728546+0000","last_change":"2023-08-25T09:42:01.263253+0000","last_active":"2023-08-25T09:42:02.728546+0000","last_peered":"2023-08-25T09:42:02.728546+0000","last_clean":"2023-08-25T09:42:02.728546+0000","last_became_active":"2023-08-25T09:42:01.263001+0000","last_became_peered":"2023-08-25T09:42:01.263001+0000","last_unstale":"2023-08-25T09:42:02.728546+0000","last_undegraded":"2023-08-25T09:42:02.728546+0000","last_fullsized":"2023-08-25T09:42:02.728546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:41.964929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254474+0000","last_change":"2023-08-25T09:42:00.248206+0000","last_active":"2023-08-25T09:42:02.254474+0000","last_peered":"2023-08-25T09:42:02.254474+0000","last_clean":"2023-08-25T09:42:02.254474+0000","last_became_active":"2023-08-25T09:42:00.247625+0000","last_became_peered":"2023-08-25T09:42:00.247625+0000","last_unstale":"2023-08-25T09:42:02.254474+0000","last_undegraded":"2023-08-25T09:42:02.254474+0000","last_fullsized":"2023-08-25T09:42:02.254474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142542+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:03.142542+0000","last_peered":"2023-08-25T09:42:03.142542+0000","last_clean":"2023-08-25T09:42:03.142542+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:03.142542+0000","last_undegraded":"2023-08-25T09:42:03.142542+0000","last_fullsized":"2023-08-25T09:42:03.142542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:46.536888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253996+0000","last_change":"2023-08-25T09:42:01.263406+0000","last_active":"2023-08-25T09:42:02.253996+0000","last_peered":"2023-08-25T09:42:02.253996+0000","last_clean":"2023-08-25T09:42:02.253996+0000","last_became_active":"2023-08-25T09:42:01.263143+0000","last_became_peered":"2023-08-25T09:42:01.263143+0000","last_unstale":"2023-08-25T09:42:02.253996+0000","last_undegraded":"2023-08-25T09:42:02.253996+0000","last_fullsized":"2023-08-25T09:42:02.253996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728789+0000","last_change":"2023-08-25T09:42:00.253767+0000","last_active":"2023-08-25T09:42:02.728789+0000","last_peered":"2023-08-25T09:42:02.728789+0000","last_clean":"2023-08-25T09:42:02.728789+0000","last_became_active":"2023-08-25T09:42:00.253460+0000","last_became_peered":"2023-08-25T09:42:00.253460+0000","last_unstale":"2023-08-25T09:42:02.728789+0000","last_undegraded":"2023-08-25T09:42:02.728789+0000","last_fullsized":"2023-08-25T09:42:02.728789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:57.298027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142868+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:03.142868+0000","last_peered":"2023-08-25T09:42:03.142868+0000","last_clean":"2023-08-25T09:42:03.142868+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:03.142868+0000","last_undegraded":"2023-08-25T09:42:03.142868+0000","last_fullsized":"2023-08-25T09:42:03.142868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:37:45.116830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257770+0000","last_change":"2023-08-25T09:42:01.258092+0000","last_active":"2023-08-25T09:42:02.257770+0000","last_peered":"2023-08-25T09:42:02.257770+0000","last_clean":"2023-08-25T09:42:02.257770+0000","last_became_active":"2023-08-25T09:42:01.257828+0000","last_became_peered":"2023-08-25T09:42:01.257828+0000","last_unstale":"2023-08-25T09:42:02.257770+0000","last_undegraded":"2023-08-25T09:42:02.257770+0000","last_fullsized":"2023-08-25T09:42:02.257770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:41.964929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258184+0000","last_change":"2023-08-25T09:42:01.255733+0000","last_active":"2023-08-25T09:42:02.258184+0000","last_peered":"2023-08-25T09:42:02.258184+0000","last_clean":"2023-08-25T09:42:02.258184+0000","last_became_active":"2023-08-25T09:42:01.255412+0000","last_became_peered":"2023-08-25T09:42:01.255412+0000","last_unstale":"2023-08-25T09:42:02.258184+0000","last_undegraded":"2023-08-25T09:42:02.258184+0000","last_fullsized":"2023-08-25T09:42:02.258184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258437+0000","last_change":"2023-08-25T09:42:00.255320+0000","last_active":"2023-08-25T09:42:02.258437+0000","last_peered":"2023-08-25T09:42:02.258437+0000","last_clean":"2023-08-25T09:42:02.258437+0000","last_became_active":"2023-08-25T09:42:00.254861+0000","last_became_peered":"2023-08-25T09:42:00.254861+0000","last_unstale":"2023-08-25T09:42:02.258437+0000","last_undegraded":"2023-08-25T09:42:02.258437+0000","last_fullsized":"2023-08-25T09:42:02.258437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:04.608504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142304+0000","last_change":"2023-08-25T09:42:01.267806+0000","last_active":"2023-08-25T09:42:03.142304+0000","last_peered":"2023-08-25T09:42:03.142304+0000","last_clean":"2023-08-25T09:42:03.142304+0000","last_became_active":"2023-08-25T09:42:01.267493+0000","last_became_peered":"2023-08-25T09:42:01.267493+0000","last_unstale":"2023-08-25T09:42:03.142304+0000","last_undegraded":"2023-08-25T09:42:03.142304+0000","last_fullsized":"2023-08-25T09:42:03.142304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143653+0000","last_change":"2023-08-25T09:42:00.250835+0000","last_active":"2023-08-25T09:42:03.143653+0000","last_peered":"2023-08-25T09:42:03.143653+0000","last_clean":"2023-08-25T09:42:03.143653+0000","last_became_active":"2023-08-25T09:42:00.250544+0000","last_became_peered":"2023-08-25T09:42:00.250544+0000","last_unstale":"2023-08-25T09:42:03.143653+0000","last_undegraded":"2023-08-25T09:42:03.143653+0000","last_fullsized":"2023-08-25T09:42:03.143653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:30.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143222+0000","last_change":"2023-08-25T09:42:00.245718+0000","last_active":"2023-08-25T09:42:03.143222+0000","last_peered":"2023-08-25T09:42:03.143222+0000","last_clean":"2023-08-25T09:42:03.143222+0000","last_became_active":"2023-08-25T09:42:00.245428+0000","last_became_peered":"2023-08-25T09:42:00.245428+0000","last_unstale":"2023-08-25T09:42:03.143222+0000","last_undegraded":"2023-08-25T09:42:03.143222+0000","last_fullsized":"2023-08-25T09:42:03.143222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:30.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254101+0000","last_change":"2023-08-25T09:42:01.263577+0000","last_active":"2023-08-25T09:42:02.254101+0000","last_peered":"2023-08-25T09:42:02.254101+0000","last_clean":"2023-08-25T09:42:02.254101+0000","last_became_active":"2023-08-25T09:42:01.263306+0000","last_became_peered":"2023-08-25T09:42:01.263306+0000","last_unstale":"2023-08-25T09:42:02.254101+0000","last_undegraded":"2023-08-25T09:42:02.254101+0000","last_fullsized":"2023-08-25T09:42:02.254101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728858+0000","last_change":"2023-08-25T09:42:00.252574+0000","last_active":"2023-08-25T09:42:02.728858+0000","last_peered":"2023-08-25T09:42:02.728858+0000","last_clean":"2023-08-25T09:42:02.728858+0000","last_became_active":"2023-08-25T09:42:00.252212+0000","last_became_peered":"2023-08-25T09:42:00.252212+0000","last_unstale":"2023-08-25T09:42:02.728858+0000","last_undegraded":"2023-08-25T09:42:02.728858+0000","last_fullsized":"2023-08-25T09:42:02.728858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253927+0000","last_change":"2023-08-25T09:42:01.264840+0000","last_active":"2023-08-25T09:42:02.253927+0000","last_peered":"2023-08-25T09:42:02.253927+0000","last_clean":"2023-08-25T09:42:02.253927+0000","last_became_active":"2023-08-25T09:42:01.264587+0000","last_became_peered":"2023-08-25T09:42:01.264587+0000","last_unstale":"2023-08-25T09:42:02.253927+0000","last_undegraded":"2023-08-25T09:42:02.253927+0000","last_fullsized":"2023-08-25T09:42:02.253927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:58:17.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142685+0000","last_change":"2023-08-25T09:42:01.254378+0000","last_active":"2023-08-25T09:42:03.142685+0000","last_peered":"2023-08-25T09:42:03.142685+0000","last_clean":"2023-08-25T09:42:03.142685+0000","last_became_active":"2023-08-25T09:42:01.254119+0000","last_became_peered":"2023-08-25T09:42:01.254119+0000","last_unstale":"2023-08-25T09:42:03.142685+0000","last_undegraded":"2023-08-25T09:42:03.142685+0000","last_fullsized":"2023-08-25T09:42:03.142685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:59:38.136685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254075+0000","last_change":"2023-08-25T09:42:00.251114+0000","last_active":"2023-08-25T09:42:02.254075+0000","last_peered":"2023-08-25T09:42:02.254075+0000","last_clean":"2023-08-25T09:42:02.254075+0000","last_became_active":"2023-08-25T09:42:00.250565+0000","last_became_peered":"2023-08-25T09:42:00.250565+0000","last_unstale":"2023-08-25T09:42:02.254075+0000","last_undegraded":"2023-08-25T09:42:02.254075+0000","last_fullsized":"2023-08-25T09:42:02.254075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:40.961089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728653+0000","last_change":"2023-08-25T09:42:01.261782+0000","last_active":"2023-08-25T09:42:02.728653+0000","last_peered":"2023-08-25T09:42:02.728653+0000","last_clean":"2023-08-25T09:42:02.728653+0000","last_became_active":"2023-08-25T09:42:01.261499+0000","last_became_peered":"2023-08-25T09:42:01.261499+0000","last_unstale":"2023-08-25T09:42:02.728653+0000","last_undegraded":"2023-08-25T09:42:02.728653+0000","last_fullsized":"2023-08-25T09:42:02.728653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142273+0000","last_change":"2023-08-25T09:42:00.246237+0000","last_active":"2023-08-25T09:42:03.142273+0000","last_peered":"2023-08-25T09:42:03.142273+0000","last_clean":"2023-08-25T09:42:03.142273+0000","last_became_active":"2023-08-25T09:42:00.245983+0000","last_became_peered":"2023-08-25T09:42:00.245983+0000","last_unstale":"2023-08-25T09:42:03.142273+0000","last_undegraded":"2023-08-25T09:42:03.142273+0000","last_fullsized":"2023-08-25T09:42:03.142273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:40.961089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254335+0000","last_change":"2023-08-25T09:42:01.264960+0000","last_active":"2023-08-25T09:42:02.254335+0000","last_peered":"2023-08-25T09:42:02.254335+0000","last_clean":"2023-08-25T09:42:02.254335+0000","last_became_active":"2023-08-25T09:42:01.264576+0000","last_became_peered":"2023-08-25T09:42:01.264576+0000","last_unstale":"2023-08-25T09:42:02.254335+0000","last_undegraded":"2023-08-25T09:42:02.254335+0000","last_fullsized":"2023-08-25T09:42:02.254335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258178+0000","last_change":"2023-08-25T09:42:00.257481+0000","last_active":"2023-08-25T09:42:02.258178+0000","last_peered":"2023-08-25T09:42:02.258178+0000","last_clean":"2023-08-25T09:42:02.258178+0000","last_became_active":"2023-08-25T09:42:00.256520+0000","last_became_peered":"2023-08-25T09:42:00.256520+0000","last_unstale":"2023-08-25T09:42:02.258178+0000","last_undegraded":"2023-08-25T09:42:02.258178+0000","last_fullsized":"2023-08-25T09:42:02.258178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:03.531753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336267+0000","last_change":"2023-08-25T09:42:01.260221+0000","last_active":"2023-08-25T09:42:02.336267+0000","last_peered":"2023-08-25T09:42:02.336267+0000","last_clean":"2023-08-25T09:42:02.336267+0000","last_became_active":"2023-08-25T09:42:01.259978+0000","last_became_peered":"2023-08-25T09:42:01.259978+0000","last_unstale":"2023-08-25T09:42:02.336267+0000","last_undegraded":"2023-08-25T09:42:02.336267+0000","last_fullsized":"2023-08-25T09:42:02.336267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:47.820393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728686+0000","last_change":"2023-08-25T09:42:00.254955+0000","last_active":"2023-08-25T09:42:02.728686+0000","last_peered":"2023-08-25T09:42:02.728686+0000","last_clean":"2023-08-25T09:42:02.728686+0000","last_became_active":"2023-08-25T09:42:00.254662+0000","last_became_peered":"2023-08-25T09:42:00.254662+0000","last_unstale":"2023-08-25T09:42:02.728686+0000","last_undegraded":"2023-08-25T09:42:02.728686+0000","last_fullsized":"2023-08-25T09:42:02.728686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:42.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257933+0000","last_change":"2023-08-25T09:42:01.267712+0000","last_active":"2023-08-25T09:42:02.257933+0000","last_peered":"2023-08-25T09:42:02.257933+0000","last_clean":"2023-08-25T09:42:02.257933+0000","last_became_active":"2023-08-25T09:42:01.267500+0000","last_became_peered":"2023-08-25T09:42:01.267500+0000","last_unstale":"2023-08-25T09:42:02.257933+0000","last_undegraded":"2023-08-25T09:42:02.257933+0000","last_fullsized":"2023-08-25T09:42:02.257933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142588+0000","last_change":"2023-08-25T09:42:00.256003+0000","last_active":"2023-08-25T09:42:03.142588+0000","last_peered":"2023-08-25T09:42:03.142588+0000","last_clean":"2023-08-25T09:42:03.142588+0000","last_became_active":"2023-08-25T09:42:00.255738+0000","last_became_peered":"2023-08-25T09:42:00.255738+0000","last_unstale":"2023-08-25T09:42:03.142588+0000","last_undegraded":"2023-08-25T09:42:03.142588+0000","last_fullsized":"2023-08-25T09:42:03.142588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257821+0000","last_change":"2023-08-25T09:42:01.262161+0000","last_active":"2023-08-25T09:42:02.257821+0000","last_peered":"2023-08-25T09:42:02.257821+0000","last_clean":"2023-08-25T09:42:02.257821+0000","last_became_active":"2023-08-25T09:42:01.261909+0000","last_became_peered":"2023-08-25T09:42:01.261909+0000","last_unstale":"2023-08-25T09:42:02.257821+0000","last_undegraded":"2023-08-25T09:42:02.257821+0000","last_fullsized":"2023-08-25T09:42:02.257821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142973+0000","last_change":"2023-08-25T09:42:00.254336+0000","last_active":"2023-08-25T09:42:03.142973+0000","last_peered":"2023-08-25T09:42:03.142973+0000","last_clean":"2023-08-25T09:42:03.142973+0000","last_became_active":"2023-08-25T09:42:00.253946+0000","last_became_peered":"2023-08-25T09:42:00.253946+0000","last_unstale":"2023-08-25T09:42:03.142973+0000","last_undegraded":"2023-08-25T09:42:03.142973+0000","last_fullsized":"2023-08-25T09:42:03.142973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:49.462578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254470+0000","last_change":"2023-08-25T09:42:01.260614+0000","last_active":"2023-08-25T09:42:02.254470+0000","last_peered":"2023-08-25T09:42:02.254470+0000","last_clean":"2023-08-25T09:42:02.254470+0000","last_became_active":"2023-08-25T09:42:01.260326+0000","last_became_peered":"2023-08-25T09:42:01.260326+0000","last_unstale":"2023-08-25T09:42:02.254470+0000","last_undegraded":"2023-08-25T09:42:02.254470+0000","last_fullsized":"2023-08-25T09:42:02.254470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254260+0000","last_change":"2023-08-25T09:42:00.249214+0000","last_active":"2023-08-25T09:42:02.254260+0000","last_peered":"2023-08-25T09:42:02.254260+0000","last_clean":"2023-08-25T09:42:02.254260+0000","last_became_active":"2023-08-25T09:42:00.248966+0000","last_became_peered":"2023-08-25T09:42:00.248966+0000","last_unstale":"2023-08-25T09:42:02.254260+0000","last_undegraded":"2023-08-25T09:42:02.254260+0000","last_fullsized":"2023-08-25T09:42:02.254260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:38.030002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257726+0000","last_change":"2023-08-25T09:42:01.255482+0000","last_active":"2023-08-25T09:42:02.257726+0000","last_peered":"2023-08-25T09:42:02.257726+0000","last_clean":"2023-08-25T09:42:02.257726+0000","last_became_active":"2023-08-25T09:42:01.254896+0000","last_became_peered":"2023-08-25T09:42:01.254896+0000","last_unstale":"2023-08-25T09:42:02.257726+0000","last_undegraded":"2023-08-25T09:42:02.257726+0000","last_fullsized":"2023-08-25T09:42:02.257726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728778+0000","last_change":"2023-08-25T09:42:00.252428+0000","last_active":"2023-08-25T09:42:02.728778+0000","last_peered":"2023-08-25T09:42:02.728778+0000","last_clean":"2023-08-25T09:42:02.728778+0000","last_became_active":"2023-08-25T09:42:00.251889+0000","last_became_peered":"2023-08-25T09:42:00.251889+0000","last_unstale":"2023-08-25T09:42:02.728778+0000","last_undegraded":"2023-08-25T09:42:02.728778+0000","last_fullsized":"2023-08-25T09:42:02.728778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:03.531753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":681795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":91267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:08.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:08.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.649+0000 7f9836d47640 1 Processor -- start 2023-08-25T09:42:08.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.649+0000 7f9836d47640 1 -- start start 2023-08-25T09:42:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9836d47640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b9ac0 0x7f98300ba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9836d47640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9830148f60 0x7f98301493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9836d47640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98300b7c20 con 0x7f98300b3250 2023-08-25T09:42:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9836d47640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300b3eb0 con 0x7f9830148f60 2023-08-25T09:42:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9836d47640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9830148820 con 0x7f98300b9ac0 2023-08-25T09:42:08.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f98352e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9830148f60 0x7f98301493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9834ae3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f98300b3250 0x7f98300b90a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55890/0 (socket says 172.21.15.89:55890) 2023-08-25T09:42:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f9834ae3640 1 -- 172.21.15.89:0/1488877525 learned_addr learned my addr 172.21.15.89:0/1488877525 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f982ffff640 1 --2- 172.21.15.89:0/1488877525 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b9ac0 0x7f98300ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f98352e4640 1 -- 172.21.15.89:0/1488877525 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b9ac0 msgr2=0x7f98300ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f98352e4640 1 --2- 172.21.15.89:0/1488877525 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b9ac0 0x7f98300ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f98352e4640 1 -- 172.21.15.89:0/1488877525 >> v1:172.21.15.89:6789/0 conn(0x7f98300b3250 legacy=0x7f98300b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.650+0000 7f98352e4640 1 -- 172.21.15.89:0/1488877525 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98300b9ee0 con 0x7f9830148f60 2023-08-25T09:42:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f98352e4640 1 --2- 172.21.15.89:0/1488877525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830148f60 0x7f98301493f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9828009d90 tx=0x7f982802bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabda8e068406eb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f982f7fe640 1 -- 172.21.15.89:0/1488877525 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982802ca10 con 0x7f9830148f60 2023-08-25T09:42:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f982f7fe640 1 -- 172.21.15.89:0/1488877525 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982802cb70 con 0x7f9830148f60 2023-08-25T09:42:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f982f7fe640 1 -- 172.21.15.89:0/1488877525 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828034440 con 0x7f9830148f60 2023-08-25T09:42:08.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 -- 172.21.15.89:0/1488877525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830148f60 msgr2=0x7f98301493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 --2- 172.21.15.89:0/1488877525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830148f60 0x7f98301493f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9828009d90 tx=0x7f982802bce0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 -- 172.21.15.89:0/1488877525 shutdown_connections 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 --2- 172.21.15.89:0/1488877525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830148f60 0x7f98301493f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 --2- 172.21.15.89:0/1488877525 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b9ac0 0x7f98300ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 -- 172.21.15.89:0/1488877525 >> 172.21.15.89:0/1488877525 conn(0x7f98300bab60 msgr2=0x7f98300baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 -- 172.21.15.89:0/1488877525 shutdown_connections 2023-08-25T09:42:08.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.651+0000 7f9836d47640 1 -- 172.21.15.89:0/1488877525 wait complete. 2023-08-25T09:42:08.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.652+0000 7f9836d47640 1 Processor -- start 2023-08-25T09:42:08.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.652+0000 7f9836d47640 1 -- start start 2023-08-25T09:42:08.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9836d47640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b3250 0x7f983009c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9836d47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 0x7f983009b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9836d47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9830148f60 0x7f983009b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9836d47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300a31f0 con 0x7f98300b9ac0 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9836d47640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300a34d0 con 0x7f9830148f60 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9836d47640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300a37b0 con 0x7f98300b3250 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f982ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 0x7f983009b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f982ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 0x7f983009b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59822/0 (socket says 172.21.15.89:59822) 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f982ffff640 1 -- 172.21.15.89:0/2102125149 learned_addr learned my addr 172.21.15.89:0/2102125149 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:08.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f98352e4640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9830148f60 0x7f983009b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.653+0000 7f9834ae3640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b3250 0x7f983009c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982ffff640 1 -- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b3250 msgr2=0x7f983009c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982ffff640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b3250 0x7f983009c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982ffff640 1 -- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9830148f60 msgr2=0x7f983009b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982ffff640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9830148f60 0x7f983009b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982ffff640 1 -- 172.21.15.89:0/2102125149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009a70 con 0x7f98300b9ac0 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f98352e4640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9830148f60 0x7f983009b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:08.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982ffff640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 0x7f983009b140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f981c00c7f0 tx=0x7f981c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c004220 con 0x7f98300b9ac0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0043a0 con 0x7f98300b9ac0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98300a2d60 con 0x7f98300b9ac0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c007860 con 0x7f98300b9ac0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.654+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98301dd650 con 0x7f98300b9ac0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.655+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98300a3970 con 0x7f98300b9ac0 2023-08-25T09:42:08.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.655+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f981c007bd0 con 0x7f98300b9ac0 2023-08-25T09:42:08.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.656+0000 7f982d7fa640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f981406a050 0x7f981406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.656+0000 7f9834ae3640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f981406a050 0x7f981406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.656+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f981c088570 con 0x7f98300b9ac0 2023-08-25T09:42:08.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.656+0000 7f9834ae3640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f981406a050 0x7f981406c510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9824007fd0 tx=0x7f9824007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.660+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f981c053cd0 con 0x7f98300b9ac0 2023-08-25T09:42:08.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.825+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98300b8150 con 0x7f981406a050 2023-08-25T09:42:08.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.832+0000 7f982d7fa640 1 -- 172.21.15.89:0/2102125149 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286635 (secure 0 0 0) 0x7f9824007270 con 0x7f981406a050 2023-08-25T09:42:08.837 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:08.838 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:08.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f981406a050 msgr2=0x7f981406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f981406a050 0x7f981406c510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9824007fd0 tx=0x7f9824007c20 comp rx=0 tx=0).stop 2023-08-25T09:42:08.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 msgr2=0x7f983009b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 0x7f983009b140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f981c00c7f0 tx=0x7f981c00ccb0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 shutdown_connections 2023-08-25T09:42:08.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f981406a050 0x7f981406c510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98300b9ac0 0x7f983009b140 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9830148f60 0x7f983009b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 --2- 172.21.15.89:0/2102125149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98300b3250 0x7f983009c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 >> 172.21.15.89:0/2102125149 conn(0x7f98300bab60 msgr2=0x7f9830147720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 shutdown_connections 2023-08-25T09:42:08.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.835+0000 7f9836d47640 1 -- 172.21.15.89:0/2102125149 wait complete. 2023-08-25T09:42:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T09:42:08.501638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219300,"kb_used_data":3112,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755420,"statfs":{"total":773094113280,"available":772869550080,"internally_reserved":0,"allocated":3186688,"data_stored":1902348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001759"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336246+0000","last_change":"2023-08-25T09:42:01.258799+0000","last_active":"2023-08-25T09:42:02.336246+0000","last_peered":"2023-08-25T09:42:02.336246+0000","last_clean":"2023-08-25T09:42:02.336246+0000","last_became_active":"2023-08-25T09:42:01.258539+0000","last_became_peered":"2023-08-25T09:42:01.258539+0000","last_unstale":"2023-08-25T09:42:02.336246+0000","last_undegraded":"2023-08-25T09:42:02.336246+0000","last_fullsized":"2023-08-25T09:42:02.336246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:12:38.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142643+0000","last_change":"2023-08-25T09:42:01.264542+0000","last_active":"2023-08-25T09:42:03.142643+0000","last_peered":"2023-08-25T09:42:03.142643+0000","last_clean":"2023-08-25T09:42:03.142643+0000","last_became_active":"2023-08-25T09:42:01.264347+0000","last_became_peered":"2023-08-25T09:42:01.264347+0000","last_unstale":"2023-08-25T09:42:03.142643+0000","last_undegraded":"2023-08-25T09:42:03.142643+0000","last_fullsized":"2023-08-25T09:42:03.142643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258291+0000","last_change":"2023-08-25T09:42:01.257154+0000","last_active":"2023-08-25T09:42:02.258291+0000","last_peered":"2023-08-25T09:42:02.258291+0000","last_clean":"2023-08-25T09:42:02.258291+0000","last_became_active":"2023-08-25T09:42:01.256873+0000","last_became_peered":"2023-08-25T09:42:01.256873+0000","last_unstale":"2023-08-25T09:42:02.258291+0000","last_undegraded":"2023-08-25T09:42:02.258291+0000","last_fullsized":"2023-08-25T09:42:02.258291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:51.558349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142554+0000","last_change":"2023-08-25T09:42:01.257367+0000","last_active":"2023-08-25T09:42:03.142554+0000","last_peered":"2023-08-25T09:42:03.142554+0000","last_clean":"2023-08-25T09:42:03.142554+0000","last_became_active":"2023-08-25T09:42:01.257057+0000","last_became_peered":"2023-08-25T09:42:01.257057+0000","last_unstale":"2023-08-25T09:42:03.142554+0000","last_undegraded":"2023-08-25T09:42:03.142554+0000","last_fullsized":"2023-08-25T09:42:03.142554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:05:40.940630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728702+0000","last_change":"2023-08-25T09:42:01.267922+0000","last_active":"2023-08-25T09:42:02.728702+0000","last_peered":"2023-08-25T09:42:02.728702+0000","last_clean":"2023-08-25T09:42:02.728702+0000","last_became_active":"2023-08-25T09:42:01.267659+0000","last_became_peered":"2023-08-25T09:42:01.267659+0000","last_unstale":"2023-08-25T09:42:02.728702+0000","last_undegraded":"2023-08-25T09:42:02.728702+0000","last_fullsized":"2023-08-25T09:42:02.728702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257835+0000","last_change":"2023-08-25T09:42:01.259471+0000","last_active":"2023-08-25T09:42:02.257835+0000","last_peered":"2023-08-25T09:42:02.257835+0000","last_clean":"2023-08-25T09:42:02.257835+0000","last_became_active":"2023-08-25T09:42:01.259153+0000","last_became_peered":"2023-08-25T09:42:01.259153+0000","last_unstale":"2023-08-25T09:42:02.257835+0000","last_undegraded":"2023-08-25T09:42:02.257835+0000","last_fullsized":"2023-08-25T09:42:02.257835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143444+0000","last_change":"2023-08-25T09:42:01.256881+0000","last_active":"2023-08-25T09:42:03.143444+0000","last_peered":"2023-08-25T09:42:03.143444+0000","last_clean":"2023-08-25T09:42:03.143444+0000","last_became_active":"2023-08-25T09:42:01.256614+0000","last_became_peered":"2023-08-25T09:42:01.256614+0000","last_unstale":"2023-08-25T09:42:03.143444+0000","last_undegraded":"2023-08-25T09:42:03.143444+0000","last_fullsized":"2023-08-25T09:42:03.143444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:51.558349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142267+0000","last_change":"2023-08-25T09:42:01.254639+0000","last_active":"2023-08-25T09:42:03.142267+0000","last_peered":"2023-08-25T09:42:03.142267+0000","last_clean":"2023-08-25T09:42:03.142267+0000","last_became_active":"2023-08-25T09:42:01.254372+0000","last_became_peered":"2023-08-25T09:42:01.254372+0000","last_unstale":"2023-08-25T09:42:03.142267+0000","last_undegraded":"2023-08-25T09:42:03.142267+0000","last_fullsized":"2023-08-25T09:42:03.142267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728688+0000","last_change":"2023-08-25T09:42:01.267841+0000","last_active":"2023-08-25T09:42:02.728688+0000","last_peered":"2023-08-25T09:42:02.728688+0000","last_clean":"2023-08-25T09:42:02.728688+0000","last_became_active":"2023-08-25T09:42:01.267577+0000","last_became_peered":"2023-08-25T09:42:01.267577+0000","last_unstale":"2023-08-25T09:42:02.728688+0000","last_undegraded":"2023-08-25T09:42:02.728688+0000","last_fullsized":"2023-08-25T09:42:02.728688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:00.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142787+0000","last_change":"2023-08-25T09:42:01.261973+0000","last_active":"2023-08-25T09:42:03.142787+0000","last_peered":"2023-08-25T09:42:03.142787+0000","last_clean":"2023-08-25T09:42:03.142787+0000","last_became_active":"2023-08-25T09:42:01.261680+0000","last_became_peered":"2023-08-25T09:42:01.261680+0000","last_unstale":"2023-08-25T09:42:03.142787+0000","last_undegraded":"2023-08-25T09:42:03.142787+0000","last_fullsized":"2023-08-25T09:42:03.142787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258455+0000","last_change":"2023-08-25T09:42:01.259665+0000","last_active":"2023-08-25T09:42:02.258455+0000","last_peered":"2023-08-25T09:42:02.258455+0000","last_clean":"2023-08-25T09:42:02.258455+0000","last_became_active":"2023-08-25T09:42:01.258452+0000","last_became_peered":"2023-08-25T09:42:01.258452+0000","last_unstale":"2023-08-25T09:42:02.258455+0000","last_undegraded":"2023-08-25T09:42:02.258455+0000","last_fullsized":"2023-08-25T09:42:02.258455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:22:27.508892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336194+0000","last_change":"2023-08-25T09:42:01.252618+0000","last_active":"2023-08-25T09:42:02.336194+0000","last_peered":"2023-08-25T09:42:02.336194+0000","last_clean":"2023-08-25T09:42:02.336194+0000","last_became_active":"2023-08-25T09:42:01.252376+0000","last_became_peered":"2023-08-25T09:42:01.252376+0000","last_unstale":"2023-08-25T09:42:02.336194+0000","last_undegraded":"2023-08-25T09:42:02.336194+0000","last_fullsized":"2023-08-25T09:42:02.336194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:19:44.292634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336119+0000","last_change":"2023-08-25T09:42:01.262167+0000","last_active":"2023-08-25T09:42:02.336119+0000","last_peered":"2023-08-25T09:42:02.336119+0000","last_clean":"2023-08-25T09:42:02.336119+0000","last_became_active":"2023-08-25T09:42:01.261920+0000","last_became_peered":"2023-08-25T09:42:01.261920+0000","last_unstale":"2023-08-25T09:42:02.336119+0000","last_undegraded":"2023-08-25T09:42:02.336119+0000","last_fullsized":"2023-08-25T09:42:02.336119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:08:36.747182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142597+0000","last_change":"2023-08-25T09:42:01.260457+0000","last_active":"2023-08-25T09:42:03.142597+0000","last_peered":"2023-08-25T09:42:03.142597+0000","last_clean":"2023-08-25T09:42:03.142597+0000","last_became_active":"2023-08-25T09:42:01.260183+0000","last_became_peered":"2023-08-25T09:42:01.260183+0000","last_unstale":"2023-08-25T09:42:03.142597+0000","last_undegraded":"2023-08-25T09:42:03.142597+0000","last_fullsized":"2023-08-25T09:42:03.142597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143571+0000","last_change":"2023-08-25T09:42:01.259993+0000","last_active":"2023-08-25T09:42:03.143571+0000","last_peered":"2023-08-25T09:42:03.143571+0000","last_clean":"2023-08-25T09:42:03.143571+0000","last_became_active":"2023-08-25T09:42:01.259579+0000","last_became_peered":"2023-08-25T09:42:01.259579+0000","last_unstale":"2023-08-25T09:42:03.143571+0000","last_undegraded":"2023-08-25T09:42:03.143571+0000","last_fullsized":"2023-08-25T09:42:03.143571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:05.612344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257642+0000","last_change":"2023-08-25T09:42:01.257372+0000","last_active":"2023-08-25T09:42:02.257642+0000","last_peered":"2023-08-25T09:42:02.257642+0000","last_clean":"2023-08-25T09:42:02.257642+0000","last_became_active":"2023-08-25T09:42:01.257077+0000","last_became_peered":"2023-08-25T09:42:01.257077+0000","last_unstale":"2023-08-25T09:42:02.257642+0000","last_undegraded":"2023-08-25T09:42:02.257642+0000","last_fullsized":"2023-08-25T09:42:02.257642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728745+0000","last_change":"2023-08-25T09:42:01.267837+0000","last_active":"2023-08-25T09:42:02.728745+0000","last_peered":"2023-08-25T09:42:02.728745+0000","last_clean":"2023-08-25T09:42:02.728745+0000","last_became_active":"2023-08-25T09:42:01.267563+0000","last_became_peered":"2023-08-25T09:42:01.267563+0000","last_unstale":"2023-08-25T09:42:02.728745+0000","last_undegraded":"2023-08-25T09:42:02.728745+0000","last_fullsized":"2023-08-25T09:42:02.728745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258405+0000","last_change":"2023-08-25T09:42:01.251722+0000","last_active":"2023-08-25T09:42:02.258405+0000","last_peered":"2023-08-25T09:42:02.258405+0000","last_clean":"2023-08-25T09:42:02.258405+0000","last_became_active":"2023-08-25T09:42:01.251444+0000","last_became_peered":"2023-08-25T09:42:01.251444+0000","last_unstale":"2023-08-25T09:42:02.258405+0000","last_undegraded":"2023-08-25T09:42:02.258405+0000","last_fullsized":"2023-08-25T09:42:02.258405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:50.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336188+0000","last_change":"2023-08-25T09:42:01.256422+0000","last_active":"2023-08-25T09:42:02.336188+0000","last_peered":"2023-08-25T09:42:02.336188+0000","last_clean":"2023-08-25T09:42:02.336188+0000","last_became_active":"2023-08-25T09:42:01.256143+0000","last_became_peered":"2023-08-25T09:42:01.256143+0000","last_unstale":"2023-08-25T09:42:02.336188+0000","last_undegraded":"2023-08-25T09:42:02.336188+0000","last_fullsized":"2023-08-25T09:42:02.336188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:42:37.275739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258100+0000","last_change":"2023-08-25T09:42:01.254888+0000","last_active":"2023-08-25T09:42:02.258100+0000","last_peered":"2023-08-25T09:42:02.258100+0000","last_clean":"2023-08-25T09:42:02.258100+0000","last_became_active":"2023-08-25T09:42:01.254618+0000","last_became_peered":"2023-08-25T09:42:01.254618+0000","last_unstale":"2023-08-25T09:42:02.258100+0000","last_undegraded":"2023-08-25T09:42:02.258100+0000","last_fullsized":"2023-08-25T09:42:02.258100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143782+0000","last_change":"2023-08-25T09:42:01.262256+0000","last_active":"2023-08-25T09:42:03.143782+0000","last_peered":"2023-08-25T09:42:03.143782+0000","last_clean":"2023-08-25T09:42:03.143782+0000","last_became_active":"2023-08-25T09:42:01.261965+0000","last_became_peered":"2023-08-25T09:42:01.261965+0000","last_unstale":"2023-08-25T09:42:03.143782+0000","last_undegraded":"2023-08-25T09:42:03.143782+0000","last_fullsized":"2023-08-25T09:42:03.143782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:15.095999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728348+0000","last_change":"2023-08-25T09:42:01.265542+0000","last_active":"2023-08-25T09:42:02.728348+0000","last_peered":"2023-08-25T09:42:02.728348+0000","last_clean":"2023-08-25T09:42:02.728348+0000","last_became_active":"2023-08-25T09:42:01.265296+0000","last_became_peered":"2023-08-25T09:42:01.265296+0000","last_unstale":"2023-08-25T09:42:02.728348+0000","last_undegraded":"2023-08-25T09:42:02.728348+0000","last_fullsized":"2023-08-25T09:42:02.728348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253971+0000","last_change":"2023-08-25T09:42:01.263034+0000","last_active":"2023-08-25T09:42:02.253971+0000","last_peered":"2023-08-25T09:42:02.253971+0000","last_clean":"2023-08-25T09:42:02.253971+0000","last_became_active":"2023-08-25T09:42:01.262773+0000","last_became_peered":"2023-08-25T09:42:01.262773+0000","last_unstale":"2023-08-25T09:42:02.253971+0000","last_undegraded":"2023-08-25T09:42:02.253971+0000","last_fullsized":"2023-08-25T09:42:02.253971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:56.312317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143207+0000","last_change":"2023-08-25T09:42:01.258737+0000","last_active":"2023-08-25T09:42:03.143207+0000","last_peered":"2023-08-25T09:42:03.143207+0000","last_clean":"2023-08-25T09:42:03.143207+0000","last_became_active":"2023-08-25T09:42:01.258445+0000","last_became_peered":"2023-08-25T09:42:01.258445+0000","last_unstale":"2023-08-25T09:42:03.143207+0000","last_undegraded":"2023-08-25T09:42:03.143207+0000","last_fullsized":"2023-08-25T09:42:03.143207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142419+0000","last_change":"2023-08-25T09:42:01.268325+0000","last_active":"2023-08-25T09:42:03.142419+0000","last_peered":"2023-08-25T09:42:03.142419+0000","last_clean":"2023-08-25T09:42:03.142419+0000","last_became_active":"2023-08-25T09:42:01.268052+0000","last_became_peered":"2023-08-25T09:42:01.268052+0000","last_unstale":"2023-08-25T09:42:03.142419+0000","last_undegraded":"2023-08-25T09:42:03.142419+0000","last_fullsized":"2023-08-25T09:42:03.142419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142567+0000","last_change":"2023-08-25T09:42:01.265227+0000","last_active":"2023-08-25T09:42:03.142567+0000","last_peered":"2023-08-25T09:42:03.142567+0000","last_clean":"2023-08-25T09:42:03.142567+0000","last_became_active":"2023-08-25T09:42:01.264910+0000","last_became_peered":"2023-08-25T09:42:01.264910+0000","last_unstale":"2023-08-25T09:42:03.142567+0000","last_undegraded":"2023-08-25T09:42:03.142567+0000","last_fullsized":"2023-08-25T09:42:03.142567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142676+0000","last_change":"2023-08-25T09:42:01.260658+0000","last_active":"2023-08-25T09:42:03.142676+0000","last_peered":"2023-08-25T09:42:03.142676+0000","last_clean":"2023-08-25T09:42:03.142676+0000","last_became_active":"2023-08-25T09:42:01.260393+0000","last_became_peered":"2023-08-25T09:42:01.260393+0000","last_unstale":"2023-08-25T09:42:03.142676+0000","last_undegraded":"2023-08-25T09:42:03.142676+0000","last_fullsized":"2023-08-25T09:42:03.142676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142579+0000","last_change":"2023-08-25T09:42:01.262364+0000","last_active":"2023-08-25T09:42:03.142579+0000","last_peered":"2023-08-25T09:42:03.142579+0000","last_clean":"2023-08-25T09:42:03.142579+0000","last_became_active":"2023-08-25T09:42:01.261630+0000","last_became_peered":"2023-08-25T09:42:01.261630+0000","last_unstale":"2023-08-25T09:42:03.142579+0000","last_undegraded":"2023-08-25T09:42:03.142579+0000","last_fullsized":"2023-08-25T09:42:03.142579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:29.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254397+0000","last_change":"2023-08-25T09:42:01.263704+0000","last_active":"2023-08-25T09:42:02.254397+0000","last_peered":"2023-08-25T09:42:02.254397+0000","last_clean":"2023-08-25T09:42:02.254397+0000","last_became_active":"2023-08-25T09:42:01.263194+0000","last_became_peered":"2023-08-25T09:42:01.263194+0000","last_unstale":"2023-08-25T09:42:02.254397+0000","last_undegraded":"2023-08-25T09:42:02.254397+0000","last_fullsized":"2023-08-25T09:42:02.254397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:04.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258087+0000","last_change":"2023-08-25T09:42:01.256034+0000","last_active":"2023-08-25T09:42:02.258087+0000","last_peered":"2023-08-25T09:42:02.258087+0000","last_clean":"2023-08-25T09:42:02.258087+0000","last_became_active":"2023-08-25T09:42:01.255754+0000","last_became_peered":"2023-08-25T09:42:01.255754+0000","last_unstale":"2023-08-25T09:42:02.258087+0000","last_undegraded":"2023-08-25T09:42:02.258087+0000","last_fullsized":"2023-08-25T09:42:02.258087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253974+0000","last_change":"2023-08-25T09:42:01.265526+0000","last_active":"2023-08-25T09:42:02.253974+0000","last_peered":"2023-08-25T09:42:02.253974+0000","last_clean":"2023-08-25T09:42:02.253974+0000","last_became_active":"2023-08-25T09:42:01.265261+0000","last_became_peered":"2023-08-25T09:42:01.265261+0000","last_unstale":"2023-08-25T09:42:02.253974+0000","last_undegraded":"2023-08-25T09:42:02.253974+0000","last_fullsized":"2023-08-25T09:42:02.253974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:31.931382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142922+0000","last_change":"2023-08-25T09:42:01.255047+0000","last_active":"2023-08-25T09:42:03.142922+0000","last_peered":"2023-08-25T09:42:03.142922+0000","last_clean":"2023-08-25T09:42:03.142922+0000","last_became_active":"2023-08-25T09:42:01.254784+0000","last_became_peered":"2023-08-25T09:42:01.254784+0000","last_unstale":"2023-08-25T09:42:03.142922+0000","last_undegraded":"2023-08-25T09:42:03.142922+0000","last_fullsized":"2023-08-25T09:42:03.142922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:46:38.947826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254200+0000","last_change":"2023-08-25T09:42:01.265446+0000","last_active":"2023-08-25T09:42:02.254200+0000","last_peered":"2023-08-25T09:42:02.254200+0000","last_clean":"2023-08-25T09:42:02.254200+0000","last_became_active":"2023-08-25T09:42:01.265198+0000","last_became_peered":"2023-08-25T09:42:01.265198+0000","last_unstale":"2023-08-25T09:42:02.254200+0000","last_undegraded":"2023-08-25T09:42:02.254200+0000","last_fullsized":"2023-08-25T09:42:02.254200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:00.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143462+0000","last_change":"2023-08-25T09:42:00.256713+0000","last_active":"2023-08-25T09:42:03.143462+0000","last_peered":"2023-08-25T09:42:03.143462+0000","last_clean":"2023-08-25T09:42:03.143462+0000","last_became_active":"2023-08-25T09:42:00.256481+0000","last_became_peered":"2023-08-25T09:42:00.256481+0000","last_unstale":"2023-08-25T09:42:03.143462+0000","last_undegraded":"2023-08-25T09:42:03.143462+0000","last_fullsized":"2023-08-25T09:42:03.143462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:49.462578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142835+0000","last_change":"2023-08-25T09:42:01.260370+0000","last_active":"2023-08-25T09:42:03.142835+0000","last_peered":"2023-08-25T09:42:03.142835+0000","last_clean":"2023-08-25T09:42:03.142835+0000","last_became_active":"2023-08-25T09:42:01.260045+0000","last_became_peered":"2023-08-25T09:42:01.260045+0000","last_unstale":"2023-08-25T09:42:03.142835+0000","last_undegraded":"2023-08-25T09:42:03.142835+0000","last_fullsized":"2023-08-25T09:42:03.142835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:29.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728456+0000","last_change":"2023-08-25T09:42:00.251152+0000","last_active":"2023-08-25T09:42:02.728456+0000","last_peered":"2023-08-25T09:42:02.728456+0000","last_clean":"2023-08-25T09:42:02.728456+0000","last_became_active":"2023-08-25T09:42:00.250252+0000","last_became_peered":"2023-08-25T09:42:00.250252+0000","last_unstale":"2023-08-25T09:42:02.728456+0000","last_undegraded":"2023-08-25T09:42:02.728456+0000","last_fullsized":"2023-08-25T09:42:02.728456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:30.927542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728763+0000","last_change":"2023-08-25T09:42:01.262193+0000","last_active":"2023-08-25T09:42:02.728763+0000","last_peered":"2023-08-25T09:42:02.728763+0000","last_clean":"2023-08-25T09:42:02.728763+0000","last_became_active":"2023-08-25T09:42:01.261925+0000","last_became_peered":"2023-08-25T09:42:01.261925+0000","last_unstale":"2023-08-25T09:42:02.728763+0000","last_undegraded":"2023-08-25T09:42:02.728763+0000","last_fullsized":"2023-08-25T09:42:02.728763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143738+0000","last_change":"2023-08-25T09:42:00.255617+0000","last_active":"2023-08-25T09:42:03.143738+0000","last_peered":"2023-08-25T09:42:03.143738+0000","last_clean":"2023-08-25T09:42:03.143738+0000","last_became_active":"2023-08-25T09:42:00.255346+0000","last_became_peered":"2023-08-25T09:42:00.255346+0000","last_unstale":"2023-08-25T09:42:03.143738+0000","last_undegraded":"2023-08-25T09:42:03.143738+0000","last_fullsized":"2023-08-25T09:42:03.143738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:28:09.575735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254340+0000","last_change":"2023-08-25T09:42:01.263525+0000","last_active":"2023-08-25T09:42:02.254340+0000","last_peered":"2023-08-25T09:42:02.254340+0000","last_clean":"2023-08-25T09:42:02.254340+0000","last_became_active":"2023-08-25T09:42:01.263253+0000","last_became_peered":"2023-08-25T09:42:01.263253+0000","last_unstale":"2023-08-25T09:42:02.254340+0000","last_undegraded":"2023-08-25T09:42:02.254340+0000","last_fullsized":"2023-08-25T09:42:02.254340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142980+0000","last_change":"2023-08-25T09:42:00.252199+0000","last_active":"2023-08-25T09:42:03.142980+0000","last_peered":"2023-08-25T09:42:03.142980+0000","last_clean":"2023-08-25T09:42:03.142980+0000","last_became_active":"2023-08-25T09:42:00.251908+0000","last_became_peered":"2023-08-25T09:42:00.251908+0000","last_unstale":"2023-08-25T09:42:03.142980+0000","last_undegraded":"2023-08-25T09:42:03.142980+0000","last_fullsized":"2023-08-25T09:42:03.142980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:18:22.265214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143678+0000","last_change":"2023-08-25T09:42:00.256827+0000","last_active":"2023-08-25T09:42:03.143678+0000","last_peered":"2023-08-25T09:42:03.143678+0000","last_clean":"2023-08-25T09:42:03.143678+0000","last_became_active":"2023-08-25T09:42:00.256436+0000","last_became_peered":"2023-08-25T09:42:00.256436+0000","last_unstale":"2023-08-25T09:42:03.143678+0000","last_undegraded":"2023-08-25T09:42:03.143678+0000","last_fullsized":"2023-08-25T09:42:03.143678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:22:26.505052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142699+0000","last_change":"2023-08-25T09:42:01.260979+0000","last_active":"2023-08-25T09:42:03.142699+0000","last_peered":"2023-08-25T09:42:03.142699+0000","last_clean":"2023-08-25T09:42:03.142699+0000","last_became_active":"2023-08-25T09:42:01.260705+0000","last_became_peered":"2023-08-25T09:42:01.260705+0000","last_unstale":"2023-08-25T09:42:03.142699+0000","last_undegraded":"2023-08-25T09:42:03.142699+0000","last_fullsized":"2023-08-25T09:42:03.142699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143702+0000","last_change":"2023-08-25T09:42:00.256188+0000","last_active":"2023-08-25T09:42:03.143702+0000","last_peered":"2023-08-25T09:42:03.143702+0000","last_clean":"2023-08-25T09:42:03.143702+0000","last_became_active":"2023-08-25T09:42:00.255900+0000","last_became_peered":"2023-08-25T09:42:00.255900+0000","last_unstale":"2023-08-25T09:42:03.143702+0000","last_undegraded":"2023-08-25T09:42:03.143702+0000","last_fullsized":"2023-08-25T09:42:03.143702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:48.667851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257639+0000","last_change":"2023-08-25T09:42:01.258783+0000","last_active":"2023-08-25T09:42:02.257639+0000","last_peered":"2023-08-25T09:42:02.257639+0000","last_clean":"2023-08-25T09:42:02.257639+0000","last_became_active":"2023-08-25T09:42:01.258514+0000","last_became_peered":"2023-08-25T09:42:01.258514+0000","last_unstale":"2023-08-25T09:42:02.257639+0000","last_undegraded":"2023-08-25T09:42:02.257639+0000","last_fullsized":"2023-08-25T09:42:02.257639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:31.931382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143793+0000","last_change":"2023-08-25T09:42:00.249887+0000","last_active":"2023-08-25T09:42:03.143793+0000","last_peered":"2023-08-25T09:42:03.143793+0000","last_clean":"2023-08-25T09:42:03.143793+0000","last_became_active":"2023-08-25T09:42:00.249627+0000","last_became_peered":"2023-08-25T09:42:00.249627+0000","last_unstale":"2023-08-25T09:42:03.143793+0000","last_undegraded":"2023-08-25T09:42:03.143793+0000","last_fullsized":"2023-08-25T09:42:03.143793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:49.105687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142518+0000","last_change":"2023-08-25T09:42:01.259557+0000","last_active":"2023-08-25T09:42:03.142518+0000","last_peered":"2023-08-25T09:42:03.142518+0000","last_clean":"2023-08-25T09:42:03.142518+0000","last_became_active":"2023-08-25T09:42:01.259321+0000","last_became_peered":"2023-08-25T09:42:01.259321+0000","last_unstale":"2023-08-25T09:42:03.142518+0000","last_undegraded":"2023-08-25T09:42:03.142518+0000","last_fullsized":"2023-08-25T09:42:03.142518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:09.837898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142922+0000","last_change":"2023-08-25T09:42:00.251160+0000","last_active":"2023-08-25T09:42:03.142922+0000","last_peered":"2023-08-25T09:42:03.142922+0000","last_clean":"2023-08-25T09:42:03.142922+0000","last_became_active":"2023-08-25T09:42:00.250732+0000","last_became_peered":"2023-08-25T09:42:00.250732+0000","last_unstale":"2023-08-25T09:42:03.142922+0000","last_undegraded":"2023-08-25T09:42:03.142922+0000","last_fullsized":"2023-08-25T09:42:03.142922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:50.554509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728542+0000","last_change":"2023-08-25T09:42:01.266242+0000","last_active":"2023-08-25T09:42:02.728542+0000","last_peered":"2023-08-25T09:42:02.728542+0000","last_clean":"2023-08-25T09:42:02.728542+0000","last_became_active":"2023-08-25T09:42:01.265828+0000","last_became_peered":"2023-08-25T09:42:01.265828+0000","last_unstale":"2023-08-25T09:42:02.728542+0000","last_undegraded":"2023-08-25T09:42:02.728542+0000","last_fullsized":"2023-08-25T09:42:02.728542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254592+0000","last_change":"2023-08-25T09:42:00.252308+0000","last_active":"2023-08-25T09:42:02.254592+0000","last_peered":"2023-08-25T09:42:02.254592+0000","last_clean":"2023-08-25T09:42:02.254592+0000","last_became_active":"2023-08-25T09:42:00.252073+0000","last_became_peered":"2023-08-25T09:42:00.252073+0000","last_unstale":"2023-08-25T09:42:02.254592+0000","last_undegraded":"2023-08-25T09:42:02.254592+0000","last_fullsized":"2023-08-25T09:42:02.254592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:50.554509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258145+0000","last_change":"2023-08-25T09:42:01.258889+0000","last_active":"2023-08-25T09:42:02.258145+0000","last_peered":"2023-08-25T09:42:02.258145+0000","last_clean":"2023-08-25T09:42:02.258145+0000","last_became_active":"2023-08-25T09:42:01.258615+0000","last_became_peered":"2023-08-25T09:42:01.258615+0000","last_unstale":"2023-08-25T09:42:02.258145+0000","last_undegraded":"2023-08-25T09:42:02.258145+0000","last_fullsized":"2023-08-25T09:42:02.258145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:29.023753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142731+0000","last_change":"2023-08-25T09:42:00.255638+0000","last_active":"2023-08-25T09:42:03.142731+0000","last_peered":"2023-08-25T09:42:03.142731+0000","last_clean":"2023-08-25T09:42:03.142731+0000","last_became_active":"2023-08-25T09:42:00.255344+0000","last_became_peered":"2023-08-25T09:42:00.255344+0000","last_unstale":"2023-08-25T09:42:03.142731+0000","last_undegraded":"2023-08-25T09:42:03.142731+0000","last_fullsized":"2023-08-25T09:42:03.142731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:27.471989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258465+0000","last_change":"2023-08-25T09:42:01.251560+0000","last_active":"2023-08-25T09:42:02.258465+0000","last_peered":"2023-08-25T09:42:02.258465+0000","last_clean":"2023-08-25T09:42:02.258465+0000","last_became_active":"2023-08-25T09:42:01.251268+0000","last_became_peered":"2023-08-25T09:42:01.251268+0000","last_unstale":"2023-08-25T09:42:02.258465+0000","last_undegraded":"2023-08-25T09:42:02.258465+0000","last_fullsized":"2023-08-25T09:42:02.258465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:49.671691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257907+0000","last_change":"2023-08-25T09:42:00.254661+0000","last_active":"2023-08-25T09:42:02.257907+0000","last_peered":"2023-08-25T09:42:02.257907+0000","last_clean":"2023-08-25T09:42:02.257907+0000","last_became_active":"2023-08-25T09:42:00.253381+0000","last_became_peered":"2023-08-25T09:42:00.253381+0000","last_unstale":"2023-08-25T09:42:02.257907+0000","last_undegraded":"2023-08-25T09:42:02.257907+0000","last_fullsized":"2023-08-25T09:42:02.257907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258437+0000","last_change":"2023-08-25T09:42:01.255458+0000","last_active":"2023-08-25T09:42:02.258437+0000","last_peered":"2023-08-25T09:42:02.258437+0000","last_clean":"2023-08-25T09:42:02.258437+0000","last_became_active":"2023-08-25T09:42:01.255174+0000","last_became_peered":"2023-08-25T09:42:01.255174+0000","last_unstale":"2023-08-25T09:42:02.258437+0000","last_undegraded":"2023-08-25T09:42:02.258437+0000","last_fullsized":"2023-08-25T09:42:02.258437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:31.891505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254199+0000","last_change":"2023-08-25T09:42:00.251897+0000","last_active":"2023-08-25T09:42:02.254199+0000","last_peered":"2023-08-25T09:42:02.254199+0000","last_clean":"2023-08-25T09:42:02.254199+0000","last_became_active":"2023-08-25T09:42:00.251637+0000","last_became_peered":"2023-08-25T09:42:00.251637+0000","last_unstale":"2023-08-25T09:42:02.254199+0000","last_undegraded":"2023-08-25T09:42:02.254199+0000","last_fullsized":"2023-08-25T09:42:02.254199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:05.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142473+0000","last_change":"2023-08-25T09:42:01.262069+0000","last_active":"2023-08-25T09:42:03.142473+0000","last_peered":"2023-08-25T09:42:03.142473+0000","last_clean":"2023-08-25T09:42:03.142473+0000","last_became_active":"2023-08-25T09:42:01.261830+0000","last_became_peered":"2023-08-25T09:42:01.261830+0000","last_unstale":"2023-08-25T09:42:03.142473+0000","last_undegraded":"2023-08-25T09:42:03.142473+0000","last_fullsized":"2023-08-25T09:42:03.142473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143814+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:03.143814+0000","last_peered":"2023-08-25T09:42:03.143814+0000","last_clean":"2023-08-25T09:42:03.143814+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:03.143814+0000","last_undegraded":"2023-08-25T09:42:03.143814+0000","last_fullsized":"2023-08-25T09:42:03.143814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:18:08.583532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142670+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:03.142670+0000","last_peered":"2023-08-25T09:42:03.142670+0000","last_clean":"2023-08-25T09:42:03.142670+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:03.142670+0000","last_undegraded":"2023-08-25T09:42:03.142670+0000","last_fullsized":"2023-08-25T09:42:03.142670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:59.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254092+0000","last_change":"2023-08-25T09:42:00.247378+0000","last_active":"2023-08-25T09:42:02.254092+0000","last_peered":"2023-08-25T09:42:02.254092+0000","last_clean":"2023-08-25T09:42:02.254092+0000","last_became_active":"2023-08-25T09:42:00.247122+0000","last_became_peered":"2023-08-25T09:42:00.247122+0000","last_unstale":"2023-08-25T09:42:02.254092+0000","last_undegraded":"2023-08-25T09:42:02.254092+0000","last_fullsized":"2023-08-25T09:42:02.254092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:28.310394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142498+0000","last_change":"2023-08-25T09:42:01.253735+0000","last_active":"2023-08-25T09:42:03.142498+0000","last_peered":"2023-08-25T09:42:03.142498+0000","last_clean":"2023-08-25T09:42:03.142498+0000","last_became_active":"2023-08-25T09:42:01.253398+0000","last_became_peered":"2023-08-25T09:42:01.253398+0000","last_unstale":"2023-08-25T09:42:03.142498+0000","last_undegraded":"2023-08-25T09:42:03.142498+0000","last_fullsized":"2023-08-25T09:42:03.142498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:17:00.671122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143237+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:03.143237+0000","last_peered":"2023-08-25T09:42:03.143237+0000","last_clean":"2023-08-25T09:42:03.143237+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:03.143237+0000","last_undegraded":"2023-08-25T09:42:03.143237+0000","last_fullsized":"2023-08-25T09:42:03.143237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:24.076968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728342+0000","last_change":"2023-08-25T09:42:00.257069+0000","last_active":"2023-08-25T09:42:02.728342+0000","last_peered":"2023-08-25T09:42:02.728342+0000","last_clean":"2023-08-25T09:42:02.728342+0000","last_became_active":"2023-08-25T09:42:00.256862+0000","last_became_peered":"2023-08-25T09:42:00.256862+0000","last_unstale":"2023-08-25T09:42:02.728342+0000","last_undegraded":"2023-08-25T09:42:02.728342+0000","last_fullsized":"2023-08-25T09:42:02.728342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:58:16.721689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728703+0000","last_change":"2023-08-25T09:42:01.266329+0000","last_active":"2023-08-25T09:42:02.728703+0000","last_peered":"2023-08-25T09:42:02.728703+0000","last_clean":"2023-08-25T09:42:02.728703+0000","last_became_active":"2023-08-25T09:42:01.266071+0000","last_became_peered":"2023-08-25T09:42:01.266071+0000","last_unstale":"2023-08-25T09:42:02.728703+0000","last_undegraded":"2023-08-25T09:42:02.728703+0000","last_fullsized":"2023-08-25T09:42:02.728703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:39.033842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336077+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:02.336077+0000","last_peered":"2023-08-25T09:42:02.336077+0000","last_clean":"2023-08-25T09:42:02.336077+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:02.336077+0000","last_undegraded":"2023-08-25T09:42:02.336077+0000","last_fullsized":"2023-08-25T09:42:02.336077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:35.544962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142102+0000","last_change":"2023-08-25T09:42:00.247602+0000","last_active":"2023-08-25T09:42:03.142102+0000","last_peered":"2023-08-25T09:42:03.142102+0000","last_clean":"2023-08-25T09:42:03.142102+0000","last_became_active":"2023-08-25T09:42:00.247328+0000","last_became_peered":"2023-08-25T09:42:00.247328+0000","last_unstale":"2023-08-25T09:42:03.142102+0000","last_undegraded":"2023-08-25T09:42:03.142102+0000","last_fullsized":"2023-08-25T09:42:03.142102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:01.555687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142554+0000","last_change":"2023-08-25T09:42:01.263095+0000","last_active":"2023-08-25T09:42:03.142554+0000","last_peered":"2023-08-25T09:42:03.142554+0000","last_clean":"2023-08-25T09:42:03.142554+0000","last_became_active":"2023-08-25T09:42:01.262854+0000","last_became_peered":"2023-08-25T09:42:01.262854+0000","last_unstale":"2023-08-25T09:42:03.142554+0000","last_undegraded":"2023-08-25T09:42:03.142554+0000","last_fullsized":"2023-08-25T09:42:03.142554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:04.535593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142511+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:03.142511+0000","last_peered":"2023-08-25T09:42:03.142511+0000","last_clean":"2023-08-25T09:42:03.142511+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:03.142511+0000","last_undegraded":"2023-08-25T09:42:03.142511+0000","last_fullsized":"2023-08-25T09:42:03.142511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:38.546673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258246+0000","last_change":"2023-08-25T09:42:00.256819+0000","last_active":"2023-08-25T09:42:02.258246+0000","last_peered":"2023-08-25T09:42:02.258246+0000","last_clean":"2023-08-25T09:42:02.258246+0000","last_became_active":"2023-08-25T09:42:00.254689+0000","last_became_peered":"2023-08-25T09:42:00.254689+0000","last_unstale":"2023-08-25T09:42:02.258246+0000","last_undegraded":"2023-08-25T09:42:02.258246+0000","last_fullsized":"2023-08-25T09:42:02.258246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142413+0000","last_change":"2023-08-25T09:42:01.268038+0000","last_active":"2023-08-25T09:42:03.142413+0000","last_peered":"2023-08-25T09:42:03.142413+0000","last_clean":"2023-08-25T09:42:03.142413+0000","last_became_active":"2023-08-25T09:42:01.267785+0000","last_became_peered":"2023-08-25T09:42:01.267785+0000","last_unstale":"2023-08-25T09:42:03.142413+0000","last_undegraded":"2023-08-25T09:42:03.142413+0000","last_fullsized":"2023-08-25T09:42:03.142413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143095+0000","last_change":"2023-08-25T09:42:00.246654+0000","last_active":"2023-08-25T09:42:03.143095+0000","last_peered":"2023-08-25T09:42:03.143095+0000","last_clean":"2023-08-25T09:42:03.143095+0000","last_became_active":"2023-08-25T09:42:00.245171+0000","last_became_peered":"2023-08-25T09:42:00.245171+0000","last_unstale":"2023-08-25T09:42:03.143095+0000","last_undegraded":"2023-08-25T09:42:03.143095+0000","last_fullsized":"2023-08-25T09:42:03.143095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:04.608504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142537+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:03.142537+0000","last_peered":"2023-08-25T09:42:03.142537+0000","last_clean":"2023-08-25T09:42:03.142537+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:03.142537+0000","last_undegraded":"2023-08-25T09:42:03.142537+0000","last_fullsized":"2023-08-25T09:42:03.142537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:53.280406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142329+0000","last_change":"2023-08-25T09:42:01.262457+0000","last_active":"2023-08-25T09:42:03.142329+0000","last_peered":"2023-08-25T09:42:03.142329+0000","last_clean":"2023-08-25T09:42:03.142329+0000","last_became_active":"2023-08-25T09:42:01.262194+0000","last_became_peered":"2023-08-25T09:42:01.262194+0000","last_unstale":"2023-08-25T09:42:03.142329+0000","last_undegraded":"2023-08-25T09:42:03.142329+0000","last_fullsized":"2023-08-25T09:42:03.142329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142388+0000","last_change":"2023-08-25T09:42:00.247634+0000","last_active":"2023-08-25T09:42:03.142388+0000","last_peered":"2023-08-25T09:42:03.142388+0000","last_clean":"2023-08-25T09:42:03.142388+0000","last_became_active":"2023-08-25T09:42:00.247346+0000","last_became_peered":"2023-08-25T09:42:00.247346+0000","last_unstale":"2023-08-25T09:42:03.142388+0000","last_undegraded":"2023-08-25T09:42:03.142388+0000","last_fullsized":"2023-08-25T09:42:03.142388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143903+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:03.143903+0000","last_peered":"2023-08-25T09:42:03.143903+0000","last_clean":"2023-08-25T09:42:03.143903+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:03.143903+0000","last_undegraded":"2023-08-25T09:42:03.143903+0000","last_fullsized":"2023-08-25T09:42:03.143903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:03:50.781902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728546+0000","last_change":"2023-08-25T09:42:01.263253+0000","last_active":"2023-08-25T09:42:02.728546+0000","last_peered":"2023-08-25T09:42:02.728546+0000","last_clean":"2023-08-25T09:42:02.728546+0000","last_became_active":"2023-08-25T09:42:01.263001+0000","last_became_peered":"2023-08-25T09:42:01.263001+0000","last_unstale":"2023-08-25T09:42:02.728546+0000","last_undegraded":"2023-08-25T09:42:02.728546+0000","last_fullsized":"2023-08-25T09:42:02.728546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:41.964929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254474+0000","last_change":"2023-08-25T09:42:00.248206+0000","last_active":"2023-08-25T09:42:02.254474+0000","last_peered":"2023-08-25T09:42:02.254474+0000","last_clean":"2023-08-25T09:42:02.254474+0000","last_became_active":"2023-08-25T09:42:00.247625+0000","last_became_peered":"2023-08-25T09:42:00.247625+0000","last_unstale":"2023-08-25T09:42:02.254474+0000","last_undegraded":"2023-08-25T09:42:02.254474+0000","last_fullsized":"2023-08-25T09:42:02.254474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142542+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:03.142542+0000","last_peered":"2023-08-25T09:42:03.142542+0000","last_clean":"2023-08-25T09:42:03.142542+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:03.142542+0000","last_undegraded":"2023-08-25T09:42:03.142542+0000","last_fullsized":"2023-08-25T09:42:03.142542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:46.536888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253996+0000","last_change":"2023-08-25T09:42:01.263406+0000","last_active":"2023-08-25T09:42:02.253996+0000","last_peered":"2023-08-25T09:42:02.253996+0000","last_clean":"2023-08-25T09:42:02.253996+0000","last_became_active":"2023-08-25T09:42:01.263143+0000","last_became_peered":"2023-08-25T09:42:01.263143+0000","last_unstale":"2023-08-25T09:42:02.253996+0000","last_undegraded":"2023-08-25T09:42:02.253996+0000","last_fullsized":"2023-08-25T09:42:02.253996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728789+0000","last_change":"2023-08-25T09:42:00.253767+0000","last_active":"2023-08-25T09:42:02.728789+0000","last_peered":"2023-08-25T09:42:02.728789+0000","last_clean":"2023-08-25T09:42:02.728789+0000","last_became_active":"2023-08-25T09:42:00.253460+0000","last_became_peered":"2023-08-25T09:42:00.253460+0000","last_unstale":"2023-08-25T09:42:02.728789+0000","last_undegraded":"2023-08-25T09:42:02.728789+0000","last_fullsized":"2023-08-25T09:42:02.728789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:57.298027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142868+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:03.142868+0000","last_peered":"2023-08-25T09:42:03.142868+0000","last_clean":"2023-08-25T09:42:03.142868+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:03.142868+0000","last_undegraded":"2023-08-25T09:42:03.142868+0000","last_fullsized":"2023-08-25T09:42:03.142868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:37:45.116830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257770+0000","last_change":"2023-08-25T09:42:01.258092+0000","last_active":"2023-08-25T09:42:02.257770+0000","last_peered":"2023-08-25T09:42:02.257770+0000","last_clean":"2023-08-25T09:42:02.257770+0000","last_became_active":"2023-08-25T09:42:01.257828+0000","last_became_peered":"2023-08-25T09:42:01.257828+0000","last_unstale":"2023-08-25T09:42:02.257770+0000","last_undegraded":"2023-08-25T09:42:02.257770+0000","last_fullsized":"2023-08-25T09:42:02.257770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:41.964929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258184+0000","last_change":"2023-08-25T09:42:01.255733+0000","last_active":"2023-08-25T09:42:02.258184+0000","last_peered":"2023-08-25T09:42:02.258184+0000","last_clean":"2023-08-25T09:42:02.258184+0000","last_became_active":"2023-08-25T09:42:01.255412+0000","last_became_peered":"2023-08-25T09:42:01.255412+0000","last_unstale":"2023-08-25T09:42:02.258184+0000","last_undegraded":"2023-08-25T09:42:02.258184+0000","last_fullsized":"2023-08-25T09:42:02.258184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258437+0000","last_change":"2023-08-25T09:42:00.255320+0000","last_active":"2023-08-25T09:42:02.258437+0000","last_peered":"2023-08-25T09:42:02.258437+0000","last_clean":"2023-08-25T09:42:02.258437+0000","last_became_active":"2023-08-25T09:42:00.254861+0000","last_became_peered":"2023-08-25T09:42:00.254861+0000","last_unstale":"2023-08-25T09:42:02.258437+0000","last_undegraded":"2023-08-25T09:42:02.258437+0000","last_fullsized":"2023-08-25T09:42:02.258437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:04.608504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142304+0000","last_change":"2023-08-25T09:42:01.267806+0000","last_active":"2023-08-25T09:42:03.142304+0000","last_peered":"2023-08-25T09:42:03.142304+0000","last_clean":"2023-08-25T09:42:03.142304+0000","last_became_active":"2023-08-25T09:42:01.267493+0000","last_became_peered":"2023-08-25T09:42:01.267493+0000","last_unstale":"2023-08-25T09:42:03.142304+0000","last_undegraded":"2023-08-25T09:42:03.142304+0000","last_fullsized":"2023-08-25T09:42:03.142304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143653+0000","last_change":"2023-08-25T09:42:00.250835+0000","last_active":"2023-08-25T09:42:03.143653+0000","last_peered":"2023-08-25T09:42:03.143653+0000","last_clean":"2023-08-25T09:42:03.143653+0000","last_became_active":"2023-08-25T09:42:00.250544+0000","last_became_peered":"2023-08-25T09:42:00.250544+0000","last_unstale":"2023-08-25T09:42:03.143653+0000","last_undegraded":"2023-08-25T09:42:03.143653+0000","last_fullsized":"2023-08-25T09:42:03.143653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:30.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.143222+0000","last_change":"2023-08-25T09:42:00.245718+0000","last_active":"2023-08-25T09:42:03.143222+0000","last_peered":"2023-08-25T09:42:03.143222+0000","last_clean":"2023-08-25T09:42:03.143222+0000","last_became_active":"2023-08-25T09:42:00.245428+0000","last_became_peered":"2023-08-25T09:42:00.245428+0000","last_unstale":"2023-08-25T09:42:03.143222+0000","last_undegraded":"2023-08-25T09:42:03.143222+0000","last_fullsized":"2023-08-25T09:42:03.143222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:30.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254101+0000","last_change":"2023-08-25T09:42:01.263577+0000","last_active":"2023-08-25T09:42:02.254101+0000","last_peered":"2023-08-25T09:42:02.254101+0000","last_clean":"2023-08-25T09:42:02.254101+0000","last_became_active":"2023-08-25T09:42:01.263306+0000","last_became_peered":"2023-08-25T09:42:01.263306+0000","last_unstale":"2023-08-25T09:42:02.254101+0000","last_undegraded":"2023-08-25T09:42:02.254101+0000","last_fullsized":"2023-08-25T09:42:02.254101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:43.568133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728858+0000","last_change":"2023-08-25T09:42:00.252574+0000","last_active":"2023-08-25T09:42:02.728858+0000","last_peered":"2023-08-25T09:42:02.728858+0000","last_clean":"2023-08-25T09:42:02.728858+0000","last_became_active":"2023-08-25T09:42:00.252212+0000","last_became_peered":"2023-08-25T09:42:00.252212+0000","last_unstale":"2023-08-25T09:42:02.728858+0000","last_undegraded":"2023-08-25T09:42:02.728858+0000","last_fullsized":"2023-08-25T09:42:02.728858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:18:28.094588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.253927+0000","last_change":"2023-08-25T09:42:01.264840+0000","last_active":"2023-08-25T09:42:02.253927+0000","last_peered":"2023-08-25T09:42:02.253927+0000","last_clean":"2023-08-25T09:42:02.253927+0000","last_became_active":"2023-08-25T09:42:01.264587+0000","last_became_peered":"2023-08-25T09:42:01.264587+0000","last_unstale":"2023-08-25T09:42:02.253927+0000","last_undegraded":"2023-08-25T09:42:02.253927+0000","last_fullsized":"2023-08-25T09:42:02.253927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:58:17.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142685+0000","last_change":"2023-08-25T09:42:01.254378+0000","last_active":"2023-08-25T09:42:03.142685+0000","last_peered":"2023-08-25T09:42:03.142685+0000","last_clean":"2023-08-25T09:42:03.142685+0000","last_became_active":"2023-08-25T09:42:01.254119+0000","last_became_peered":"2023-08-25T09:42:01.254119+0000","last_unstale":"2023-08-25T09:42:03.142685+0000","last_undegraded":"2023-08-25T09:42:03.142685+0000","last_fullsized":"2023-08-25T09:42:03.142685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:59:38.136685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254075+0000","last_change":"2023-08-25T09:42:00.251114+0000","last_active":"2023-08-25T09:42:02.254075+0000","last_peered":"2023-08-25T09:42:02.254075+0000","last_clean":"2023-08-25T09:42:02.254075+0000","last_became_active":"2023-08-25T09:42:00.250565+0000","last_became_peered":"2023-08-25T09:42:00.250565+0000","last_unstale":"2023-08-25T09:42:02.254075+0000","last_undegraded":"2023-08-25T09:42:02.254075+0000","last_fullsized":"2023-08-25T09:42:02.254075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:40.961089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728653+0000","last_change":"2023-08-25T09:42:01.261782+0000","last_active":"2023-08-25T09:42:02.728653+0000","last_peered":"2023-08-25T09:42:02.728653+0000","last_clean":"2023-08-25T09:42:02.728653+0000","last_became_active":"2023-08-25T09:42:01.261499+0000","last_became_peered":"2023-08-25T09:42:01.261499+0000","last_unstale":"2023-08-25T09:42:02.728653+0000","last_undegraded":"2023-08-25T09:42:02.728653+0000","last_fullsized":"2023-08-25T09:42:02.728653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142273+0000","last_change":"2023-08-25T09:42:00.246237+0000","last_active":"2023-08-25T09:42:03.142273+0000","last_peered":"2023-08-25T09:42:03.142273+0000","last_clean":"2023-08-25T09:42:03.142273+0000","last_became_active":"2023-08-25T09:42:00.245983+0000","last_became_peered":"2023-08-25T09:42:00.245983+0000","last_unstale":"2023-08-25T09:42:03.142273+0000","last_undegraded":"2023-08-25T09:42:03.142273+0000","last_fullsized":"2023-08-25T09:42:03.142273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:40.961089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254335+0000","last_change":"2023-08-25T09:42:01.264960+0000","last_active":"2023-08-25T09:42:02.254335+0000","last_peered":"2023-08-25T09:42:02.254335+0000","last_clean":"2023-08-25T09:42:02.254335+0000","last_became_active":"2023-08-25T09:42:01.264576+0000","last_became_peered":"2023-08-25T09:42:01.264576+0000","last_unstale":"2023-08-25T09:42:02.254335+0000","last_undegraded":"2023-08-25T09:42:02.254335+0000","last_fullsized":"2023-08-25T09:42:02.254335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:53:07.161546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.258178+0000","last_change":"2023-08-25T09:42:00.257481+0000","last_active":"2023-08-25T09:42:02.258178+0000","last_peered":"2023-08-25T09:42:02.258178+0000","last_clean":"2023-08-25T09:42:02.258178+0000","last_became_active":"2023-08-25T09:42:00.256520+0000","last_became_peered":"2023-08-25T09:42:00.256520+0000","last_unstale":"2023-08-25T09:42:02.258178+0000","last_undegraded":"2023-08-25T09:42:02.258178+0000","last_fullsized":"2023-08-25T09:42:02.258178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:03.531753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.336267+0000","last_change":"2023-08-25T09:42:01.260221+0000","last_active":"2023-08-25T09:42:02.336267+0000","last_peered":"2023-08-25T09:42:02.336267+0000","last_clean":"2023-08-25T09:42:02.336267+0000","last_became_active":"2023-08-25T09:42:01.259978+0000","last_became_peered":"2023-08-25T09:42:01.259978+0000","last_unstale":"2023-08-25T09:42:02.336267+0000","last_undegraded":"2023-08-25T09:42:02.336267+0000","last_fullsized":"2023-08-25T09:42:02.336267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:47.820393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728686+0000","last_change":"2023-08-25T09:42:00.254955+0000","last_active":"2023-08-25T09:42:02.728686+0000","last_peered":"2023-08-25T09:42:02.728686+0000","last_clean":"2023-08-25T09:42:02.728686+0000","last_became_active":"2023-08-25T09:42:00.254662+0000","last_became_peered":"2023-08-25T09:42:00.254662+0000","last_unstale":"2023-08-25T09:42:02.728686+0000","last_undegraded":"2023-08-25T09:42:02.728686+0000","last_fullsized":"2023-08-25T09:42:02.728686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:42.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257933+0000","last_change":"2023-08-25T09:42:01.267712+0000","last_active":"2023-08-25T09:42:02.257933+0000","last_peered":"2023-08-25T09:42:02.257933+0000","last_clean":"2023-08-25T09:42:02.257933+0000","last_became_active":"2023-08-25T09:42:01.267500+0000","last_became_peered":"2023-08-25T09:42:01.267500+0000","last_unstale":"2023-08-25T09:42:02.257933+0000","last_undegraded":"2023-08-25T09:42:02.257933+0000","last_fullsized":"2023-08-25T09:42:02.257933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:06.966320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142588+0000","last_change":"2023-08-25T09:42:00.256003+0000","last_active":"2023-08-25T09:42:03.142588+0000","last_peered":"2023-08-25T09:42:03.142588+0000","last_clean":"2023-08-25T09:42:03.142588+0000","last_became_active":"2023-08-25T09:42:00.255738+0000","last_became_peered":"2023-08-25T09:42:00.255738+0000","last_unstale":"2023-08-25T09:42:03.142588+0000","last_undegraded":"2023-08-25T09:42:03.142588+0000","last_fullsized":"2023-08-25T09:42:03.142588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:59.968214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257821+0000","last_change":"2023-08-25T09:42:01.262161+0000","last_active":"2023-08-25T09:42:02.257821+0000","last_peered":"2023-08-25T09:42:02.257821+0000","last_clean":"2023-08-25T09:42:02.257821+0000","last_became_active":"2023-08-25T09:42:01.261909+0000","last_became_peered":"2023-08-25T09:42:01.261909+0000","last_unstale":"2023-08-25T09:42:02.257821+0000","last_undegraded":"2023-08-25T09:42:02.257821+0000","last_fullsized":"2023-08-25T09:42:02.257821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:29.314234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:03.142973+0000","last_change":"2023-08-25T09:42:00.254336+0000","last_active":"2023-08-25T09:42:03.142973+0000","last_peered":"2023-08-25T09:42:03.142973+0000","last_clean":"2023-08-25T09:42:03.142973+0000","last_became_active":"2023-08-25T09:42:00.253946+0000","last_became_peered":"2023-08-25T09:42:00.253946+0000","last_unstale":"2023-08-25T09:42:03.142973+0000","last_undegraded":"2023-08-25T09:42:03.142973+0000","last_fullsized":"2023-08-25T09:42:03.142973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:49.462578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254470+0000","last_change":"2023-08-25T09:42:01.260614+0000","last_active":"2023-08-25T09:42:02.254470+0000","last_peered":"2023-08-25T09:42:02.254470+0000","last_clean":"2023-08-25T09:42:02.254470+0000","last_became_active":"2023-08-25T09:42:01.260326+0000","last_became_peered":"2023-08-25T09:42:01.260326+0000","last_unstale":"2023-08-25T09:42:02.254470+0000","last_undegraded":"2023-08-25T09:42:02.254470+0000","last_fullsized":"2023-08-25T09:42:02.254470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:58.301867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.254260+0000","last_change":"2023-08-25T09:42:00.249214+0000","last_active":"2023-08-25T09:42:02.254260+0000","last_peered":"2023-08-25T09:42:02.254260+0000","last_clean":"2023-08-25T09:42:02.254260+0000","last_became_active":"2023-08-25T09:42:00.248966+0000","last_became_peered":"2023-08-25T09:42:00.248966+0000","last_unstale":"2023-08-25T09:42:02.254260+0000","last_undegraded":"2023-08-25T09:42:02.254260+0000","last_fullsized":"2023-08-25T09:42:02.254260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:38.030002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.257726+0000","last_change":"2023-08-25T09:42:01.255482+0000","last_active":"2023-08-25T09:42:02.257726+0000","last_peered":"2023-08-25T09:42:02.257726+0000","last_clean":"2023-08-25T09:42:02.257726+0000","last_became_active":"2023-08-25T09:42:01.254896+0000","last_became_peered":"2023-08-25T09:42:01.254896+0000","last_unstale":"2023-08-25T09:42:02.257726+0000","last_undegraded":"2023-08-25T09:42:02.257726+0000","last_fullsized":"2023-08-25T09:42:02.257726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:00.233266+0000","last_clean_scrub_stamp":"2023-08-25T09:42:00.233266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:45:02.559527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T09:42:02.728778+0000","last_change":"2023-08-25T09:42:00.252428+0000","last_active":"2023-08-25T09:42:02.728778+0000","last_peered":"2023-08-25T09:42:02.728778+0000","last_clean":"2023-08-25T09:42:02.728778+0000","last_became_active":"2023-08-25T09:42:00.251889+0000","last_became_peered":"2023-08-25T09:42:00.251889+0000","last_unstale":"2023-08-25T09:42:02.728778+0000","last_undegraded":"2023-08-25T09:42:02.728778+0000","last_fullsized":"2023-08-25T09:42:02.728778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:59.229426+0000","last_clean_scrub_stamp":"2023-08-25T09:41:59.229426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:03.531753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":681795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":91267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:08.859 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-25T09:42:08.859 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-25T09:42:08.860 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-25T09:42:08.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-25T09:42:08.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.986+0000 7fd3a2399640 1 Processor -- start 2023-08-25T09:42:08.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.986+0000 7fd3a2399640 1 -- start start 2023-08-25T09:42:08.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd3a2399640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd39c0ba300 0x7fd39c0b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd3a2399640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b82a0 0x7fd39c1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd3a2399640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c0bc580 con 0x7fd39c0b7980 2023-08-25T09:42:08.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd3a2399640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0bd400 con 0x7fd39c0ba300 2023-08-25T09:42:08.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd3a2399640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0ba740 con 0x7fd39c0b82a0 2023-08-25T09:42:08.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd39c0ba300 0x7fd39c0b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd39c0ba300 0x7fd39c0b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59834/0 (socket says 172.21.15.89:59834) 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 -- 172.21.15.89:0/3161866896 learned_addr learned my addr 172.21.15.89:0/3161866896 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd3a0936640 1 --2- 172.21.15.89:0/3161866896 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b82a0 0x7fd39c1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 -- 172.21.15.89:0/3161866896 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b82a0 msgr2=0x7fd39c1442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 --2- 172.21.15.89:0/3161866896 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b82a0 0x7fd39c1442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 -- 172.21.15.89:0/3161866896 >> v1:172.21.15.121:6789/0 conn(0x7fd39c0b7980 legacy=0x7fd39c0bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.987+0000 7fd39b7fe640 1 -- 172.21.15.89:0/3161866896 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c14de10 con 0x7fd39c0ba300 2023-08-25T09:42:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.988+0000 7fd39b7fe640 1 --2- 172.21.15.89:0/3161866896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c0b7d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd390009870 tx=0x7fd39002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ccff5cf627799 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.988+0000 7fd39affd640 1 -- 172.21.15.89:0/3161866896 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390030840 con 0x7fd39c0ba300 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.988+0000 7fd39affd640 1 -- 172.21.15.89:0/3161866896 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3900309a0 con 0x7fd39c0ba300 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.988+0000 7fd39affd640 1 -- 172.21.15.89:0/3161866896 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390030d30 con 0x7fd39c0ba300 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 -- 172.21.15.89:0/3161866896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 msgr2=0x7fd39c0b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 --2- 172.21.15.89:0/3161866896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c0b7d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd390009870 tx=0x7fd39002b980 comp rx=0 tx=0).stop 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 -- 172.21.15.89:0/3161866896 shutdown_connections 2023-08-25T09:42:08.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 --2- 172.21.15.89:0/3161866896 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b82a0 0x7fd39c1442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 --2- 172.21.15.89:0/3161866896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c0b7d60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 -- 172.21.15.89:0/3161866896 >> 172.21.15.89:0/3161866896 conn(0x7fd39c071160 msgr2=0x7fd39c0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 -- 172.21.15.89:0/3161866896 shutdown_connections 2023-08-25T09:42:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.989+0000 7fd3a2399640 1 -- 172.21.15.89:0/3161866896 wait complete. 2023-08-25T09:42:08.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.990+0000 7fd3a2399640 1 Processor -- start 2023-08-25T09:42:08.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.990+0000 7fd3a2399640 1 -- start start 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b7980 0x7fd39c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39c0b82a0 0x7fd39c1e06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c1e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c13da50 con 0x7fd39c0ba300 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c13c930 con 0x7fd39c0b82a0 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c13cb80 con 0x7fd39c0b7980 2023-08-25T09:42:08.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c1e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c1e0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59838/0 (socket says 172.21.15.89:59838) 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 -- 172.21.15.89:0/1337078632 learned_addr learned my addr 172.21.15.89:0/1337078632 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd39b7fe640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39c0b82a0 0x7fd39c1e06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd39bfff640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b7980 0x7fd39c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 -- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b7980 msgr2=0x7fd39c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b7980 0x7fd39c13e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 -- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39c0b82a0 msgr2=0x7fd39c1e06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39c0b82a0 0x7fd39c1e06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 -- 172.21.15.89:0/1337078632 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900094d0 con 0x7fd39c0ba300 2023-08-25T09:42:09.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a0936640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c1e0c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd39400efc0 tx=0x7fd39400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394009ca0 con 0x7fd39c0ba300 2023-08-25T09:42:09.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39400f040 con 0x7fd39c0ba300 2023-08-25T09:42:09.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940146c0 con 0x7fd39c0ba300 2023-08-25T09:42:09.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c13f5d0 con 0x7fd39c0ba300 2023-08-25T09:42:09.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.991+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c148990 con 0x7fd39c0ba300 2023-08-25T09:42:09.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.992+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c14b110 con 0x7fd39c0ba300 2023-08-25T09:42:09.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.993+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd394014820 con 0x7fd39c0ba300 2023-08-25T09:42:09.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.993+0000 7fd398ff9640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd38806a050 0x7fd38806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.993+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3940894e0 con 0x7fd39c0ba300 2023-08-25T09:42:09.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.993+0000 7fd39bfff640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd38806a050 0x7fd38806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.993+0000 7fd39bfff640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd38806a050 0x7fd38806c510 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd38c000f60 tx=0x7fd38c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:08.997+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd39c14b110 con 0x7fd39c0ba300 2023-08-25T09:42:09.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.198+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd39c14b110 con 0x7fd39c0ba300 2023-08-25T09:42:09.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.199+0000 7fd398ff9640 1 -- 172.21.15.89:0/1337078632 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd39c14b110 con 0x7fd39c0ba300 2023-08-25T09:42:09.203 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:09.204 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-25T09:42:09.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd38806a050 msgr2=0x7fd38806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd38806a050 0x7fd38806c510 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd38c000f60 tx=0x7fd38c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 msgr2=0x7fd39c1e0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c1e0c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd39400efc0 tx=0x7fd39400c490 comp rx=0 tx=0).stop 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 shutdown_connections 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd38806a050 0x7fd38806c510 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd39c0ba300 0x7fd39c1e0c30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd39c0b82a0 0x7fd39c1e06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 --2- 172.21.15.89:0/1337078632 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd39c0b7980 0x7fd39c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.200+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 >> 172.21.15.89:0/1337078632 conn(0x7fd39c071160 msgr2=0x7fd39c0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:09.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.201+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 shutdown_connections 2023-08-25T09:42:09.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.201+0000 7fd3a2399640 1 -- 172.21.15.89:0/1337078632 wait complete. 2023-08-25T09:42:09.214 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-25T09:42:09.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:09.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.315+0000 7f73750fa640 1 Processor -- start 2023-08-25T09:42:09.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.315+0000 7f73750fa640 1 -- start start 2023-08-25T09:42:09.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f73750fa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f737006eae0 0x7f737006bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f73750fa640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f737014b250 0x7f737006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f73750fa640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737014aac0 con 0x7f737014b6b0 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f73750fa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737006d9e0 con 0x7f737006eae0 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f73750fa640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737006c3e0 con 0x7f737014b250 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f736ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f737006eae0 0x7f737006bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f736ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f737006eae0 0x7f737006bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59850/0 (socket says 172.21.15.89:59850) 2023-08-25T09:42:09.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f736ed9d640 1 -- 172.21.15.89:0/2783717038 learned_addr learned my addr 172.21.15.89:0/2783717038 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f7367fff640 1 --2- 172.21.15.89:0/2783717038 >> v2:172.21.15.121:3300/0 conn(0x7f737014b250 0x7f737006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.316+0000 7f736ed9d640 1 -- 172.21.15.89:0/2783717038 >> v2:172.21.15.121:3300/0 conn(0x7f737014b250 msgr2=0x7f737006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736ed9d640 1 --2- 172.21.15.89:0/2783717038 >> v2:172.21.15.121:3300/0 conn(0x7f737014b250 0x7f737006b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736ed9d640 1 -- 172.21.15.89:0/2783717038 >> v1:172.21.15.121:6789/0 conn(0x7f737014b6b0 legacy=0x7f737014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736ed9d640 1 -- 172.21.15.89:0/2783717038 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737006c5e0 con 0x7f737006eae0 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736ed9d640 1 --2- 172.21.15.89:0/2783717038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737006eae0 0x7f737006bea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7370070590 tx=0x7f736002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff944c2ac3fc6f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736e59c640 1 -- 172.21.15.89:0/2783717038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360004230 con 0x7f737006eae0 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736e59c640 1 -- 172.21.15.89:0/2783717038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360004390 con 0x7f737006eae0 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.317+0000 7f736e59c640 1 -- 172.21.15.89:0/2783717038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360003810 con 0x7f737006eae0 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 -- 172.21.15.89:0/2783717038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737006eae0 msgr2=0x7f737006bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 --2- 172.21.15.89:0/2783717038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737006eae0 0x7f737006bea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7370070590 tx=0x7f736002b8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 -- 172.21.15.89:0/2783717038 shutdown_connections 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 --2- 172.21.15.89:0/2783717038 >> v2:172.21.15.121:3300/0 conn(0x7f737014b250 0x7f737006b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 --2- 172.21.15.89:0/2783717038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737006eae0 0x7f737006bea0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 -- 172.21.15.89:0/2783717038 >> 172.21.15.89:0/2783717038 conn(0x7f73700be090 msgr2=0x7f73700be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:09.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 -- 172.21.15.89:0/2783717038 shutdown_connections 2023-08-25T09:42:09.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.318+0000 7f73750fa640 1 -- 172.21.15.89:0/2783717038 wait complete. 2023-08-25T09:42:09.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.319+0000 7f73750fa640 1 Processor -- start 2023-08-25T09:42:09.326 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.319+0000 7f73750fa640 1 -- start start 2023-08-25T09:42:09.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73750fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f737006eae0 0x7f737009f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73750fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 0x7f737014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73750fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f737014b6b0 0x7f737014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73750fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737009f940 con 0x7f737014b250 2023-08-25T09:42:09.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73750fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737009fb30 con 0x7f737006eae0 2023-08-25T09:42:09.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73750fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737014cd70 con 0x7f737014b6b0 2023-08-25T09:42:09.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 0x7f737014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 0x7f737014d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59862/0 (socket says 172.21.15.89:59862) 2023-08-25T09:42:09.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f736ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f737006eae0 0x7f737009f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 -- 172.21.15.89:0/1903922305 learned_addr learned my addr 172.21.15.89:0/1903922305 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f736f59e640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f737014b6b0 0x7f737014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 -- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f737014b6b0 msgr2=0x7f737014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f737014b6b0 0x7f737014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 -- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f737006eae0 msgr2=0x7f737009f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f737006eae0 0x7f737009f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 -- 172.21.15.89:0/1903922305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360009460 con 0x7f737014b250 2023-08-25T09:42:09.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f7367fff640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 0x7f737014d200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f735800d800 tx=0x7f735800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.320+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800b6c0 con 0x7f737014b250 2023-08-25T09:42:09.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.321+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800b820 con 0x7f737014b250 2023-08-25T09:42:09.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.321+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73701dfe30 con 0x7f737014b250 2023-08-25T09:42:09.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.321+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800bbb0 con 0x7f737014b250 2023-08-25T09:42:09.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.321+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73701e0390 con 0x7f737014b250 2023-08-25T09:42:09.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.322+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7370066c50 con 0x7f737014b250 2023-08-25T09:42:09.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.322+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f735800bd10 con 0x7f737014b250 2023-08-25T09:42:09.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.322+0000 7f73677fe640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f735006a080 0x7f735006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.322+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73580888e0 con 0x7f737014b250 2023-08-25T09:42:09.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.322+0000 7f736ed9d640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f735006a080 0x7f735006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.323+0000 7f736ed9d640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f735006a080 0x7f735006c540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7360035000 tx=0x7f7360008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.326+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7358054110 con 0x7f737014b250 2023-08-25T09:42:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.493+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f737009ef70 con 0x7f737014b250 2023-08-25T09:42:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.494+0000 7f73677fe640 1 -- 172.21.15.89:0/1903922305 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f7358057730 con 0x7f737014b250 2023-08-25T09:42:09.496 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.495+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f735006a080 msgr2=0x7f735006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.495+0000 7f73750fa640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f735006a080 0x7f735006c540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7360035000 tx=0x7f7360008030 comp rx=0 tx=0).stop 2023-08-25T09:42:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.495+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 msgr2=0x7f737014d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.495+0000 7f73750fa640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 0x7f737014d200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f735800d800 tx=0x7f735800dcc0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 shutdown_connections 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f735006a080 0x7f735006c540 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f737014b250 0x7f737014d200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f737014b6b0 0x7f737014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 --2- 172.21.15.89:0/1903922305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f737006eae0 0x7f737009f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 >> 172.21.15.89:0/1903922305 conn(0x7f73700be090 msgr2=0x7f737006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:09.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 shutdown_connections 2023-08-25T09:42:09.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.496+0000 7f73750fa640 1 -- 172.21.15.89:0/1903922305 wait complete. 2023-08-25T09:42:09.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:09.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:09.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.608+0000 7f812986a640 1 Processor -- start 2023-08-25T09:42:09.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.608+0000 7f812986a640 1 -- start start 2023-08-25T09:42:09.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f812986a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81240b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f812986a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f81240b8ba0 0x7f8124147b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f812986a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81241480d0 0x7f812414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f812986a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8124148560 con 0x7f81241480d0 2023-08-25T09:42:09.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f812986a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8124141a60 con 0x7f81240b8ba0 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f812986a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240b4150 con 0x7f8124141680 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81241480d0 0x7f812414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81241480d0 0x7f812414ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59874/0 (socket says 172.21.15.89:59874) 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 -- 172.21.15.89:0/3963953445 learned_addr learned my addr 172.21.15.89:0/3963953445 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 -- 172.21.15.89:0/3963953445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 msgr2=0x7f81240b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 --2- 172.21.15.89:0/3963953445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81240b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 -- 172.21.15.89:0/3963953445 >> v2:172.21.15.121:3300/0 conn(0x7f81240b8ba0 msgr2=0x7f8124147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:09.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 --2- 172.21.15.89:0/3963953445 >> v2:172.21.15.121:3300/0 conn(0x7f81240b8ba0 0x7f8124147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.609+0000 7f81237fe640 1 -- 172.21.15.89:0/3963953445 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240711c0 con 0x7f81241480d0 2023-08-25T09:42:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.610+0000 7f81237fe640 1 --2- 172.21.15.89:0/3963953445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f812414ab50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81240ba200 tx=0x7f811c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494a067710b6152c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.610+0000 7f8121ffb640 1 -- 172.21.15.89:0/3963953445 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c031520 con 0x7f81241480d0 2023-08-25T09:42:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.610+0000 7f8121ffb640 1 -- 172.21.15.89:0/3963953445 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c031680 con 0x7f81241480d0 2023-08-25T09:42:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.610+0000 7f8121ffb640 1 -- 172.21.15.89:0/3963953445 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c031a10 con 0x7f81241480d0 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 -- 172.21.15.89:0/3963953445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 msgr2=0x7f812414ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 --2- 172.21.15.89:0/3963953445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f812414ab50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81240ba200 tx=0x7f811c02b7c0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 -- 172.21.15.89:0/3963953445 shutdown_connections 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 --2- 172.21.15.89:0/3963953445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f812414ab50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 --2- 172.21.15.89:0/3963953445 >> v2:172.21.15.121:3300/0 conn(0x7f81240b8ba0 0x7f8124147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 --2- 172.21.15.89:0/3963953445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81240b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 -- 172.21.15.89:0/3963953445 >> 172.21.15.89:0/3963953445 conn(0x7f81240bd370 msgr2=0x7f81240b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 -- 172.21.15.89:0/3963953445 shutdown_connections 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.611+0000 7f812986a640 1 -- 172.21.15.89:0/3963953445 wait complete. 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 Processor -- start 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 -- start start 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81240b8ba0 0x7f8124146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81241e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f8124141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81241470c0 con 0x7f81241480d0 2023-08-25T09:42:09.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812413da70 con 0x7f81240b8ba0 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.612+0000 7f812986a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812413dd50 con 0x7f8124141680 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f8124141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f8124141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59878/0 (socket says 172.21.15.89:59878) 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 -- 172.21.15.89:0/1425238479 learned_addr learned my addr 172.21.15.89:0/1425238479 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f8122ffd640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81240b8ba0 0x7f8124146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81227fc640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81241e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 -- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 msgr2=0x7f81241e1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81241e1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 -- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81240b8ba0 msgr2=0x7f8124146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81240b8ba0 0x7f8124146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 -- 172.21.15.89:0/1425238479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0094b0 con 0x7f81241480d0 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f8122ffd640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81240b8ba0 0x7f8124146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81227fc640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81241e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f81237fe640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f8124141e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f811c036040 tx=0x7f811c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c031520 con 0x7f81241480d0 2023-08-25T09:42:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c033c10 con 0x7f81241480d0 2023-08-25T09:42:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812413c040 con 0x7f81241480d0 2023-08-25T09:42:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c03c400 con 0x7f81241480d0 2023-08-25T09:42:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.613+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81241e1860 con 0x7f81241480d0 2023-08-25T09:42:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.614+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81240b8fa0 con 0x7f81241480d0 2023-08-25T09:42:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.615+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f811c03a040 con 0x7f81241480d0 2023-08-25T09:42:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.615+0000 7f810bfff640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f811006a050 0x7f811006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.615+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f811c0aa290 con 0x7f81241480d0 2023-08-25T09:42:09.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.615+0000 7f8122ffd640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f811006a050 0x7f811006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.616+0000 7f8122ffd640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f811006a050 0x7f811006c510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8114009fa0 tx=0x7f8114009570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.619+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f811c075b30 con 0x7f81241480d0 2023-08-25T09:42:09.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.786+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81241470c0 con 0x7f81241480d0 2023-08-25T09:42:09.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.786+0000 7f810bfff640 1 -- 172.21.15.89:0/1425238479 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f811c079150 con 0x7f81241480d0 2023-08-25T09:42:09.790 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:09.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f811006a050 msgr2=0x7f811006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f811006a050 0x7f811006c510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8114009fa0 tx=0x7f8114009570 comp rx=0 tx=0).stop 2023-08-25T09:42:09.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 msgr2=0x7f8124141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f8124141e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f811c036040 tx=0x7f811c004710 comp rx=0 tx=0).stop 2023-08-25T09:42:09.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 shutdown_connections 2023-08-25T09:42:09.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f811006a050 0x7f811006c510 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81241480d0 0x7f8124141e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8124141680 0x7f81241e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 --2- 172.21.15.89:0/1425238479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81240b8ba0 0x7f8124146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.788+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 >> 172.21.15.89:0/1425238479 conn(0x7f81240bd370 msgr2=0x7f81240b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:09.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.789+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 shutdown_connections 2023-08-25T09:42:09.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.789+0000 7f812986a640 1 -- 172.21.15.89:0/1425238479 wait complete. 2023-08-25T09:42:09.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:09.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.906+0000 7fc557999640 1 Processor -- start 2023-08-25T09:42:09.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.906+0000 7fc557999640 1 -- start start 2023-08-25T09:42:09.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc557999640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500bc890 0x7fc5500bfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc557999640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5500b39a0 0x7fc550069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc557999640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500bd850 con 0x7fc55014b510 2023-08-25T09:42:09.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc557999640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5500bf820 con 0x7fc5500b39a0 2023-08-25T09:42:09.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc557999640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500badc0 con 0x7fc5500bc890 2023-08-25T09:42:09.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5500b39a0 0x7fc550069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5500b39a0 0x7fc550069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59880/0 (socket says 172.21.15.89:59880) 2023-08-25T09:42:09.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 -- 172.21.15.89:0/186087736 learned_addr learned my addr 172.21.15.89:0/186087736 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555735640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc55014b510 0x7fc5500bd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55896/0 (socket says 172.21.15.89:55896) 2023-08-25T09:42:09.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 -- 172.21.15.89:0/186087736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500bc890 msgr2=0x7fc5500bfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:09.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 --2- 172.21.15.89:0/186087736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500bc890 0x7fc5500bfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 -- 172.21.15.89:0/186087736 >> v1:172.21.15.89:6789/0 conn(0x7fc55014b510 legacy=0x7fc5500bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc555f36640 1 -- 172.21.15.89:0/186087736 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500bed00 con 0x7fc5500b39a0 2023-08-25T09:42:09.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.907+0000 7fc547fff640 1 -- 172.21.15.89:0/186087736 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623485261 0 0) 0x7fc5500bd850 con 0x7fc55014b510 2023-08-25T09:42:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.908+0000 7fc555f36640 1 --2- 172.21.15.89:0/186087736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5500b39a0 0x7fc550069ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc548009870 tx=0x7fc54802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2ceaf28d3971e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.908+0000 7fc547fff640 1 -- 172.21.15.89:0/186087736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548030840 con 0x7fc5500b39a0 2023-08-25T09:42:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.908+0000 7fc547fff640 1 -- 172.21.15.89:0/186087736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5480309a0 con 0x7fc5500b39a0 2023-08-25T09:42:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.908+0000 7fc547fff640 1 -- 172.21.15.89:0/186087736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548030d30 con 0x7fc5500b39a0 2023-08-25T09:42:09.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 -- 172.21.15.89:0/186087736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5500b39a0 msgr2=0x7fc550069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 --2- 172.21.15.89:0/186087736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5500b39a0 0x7fc550069ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc548009870 tx=0x7fc54802b980 comp rx=0 tx=0).stop 2023-08-25T09:42:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 -- 172.21.15.89:0/186087736 shutdown_connections 2023-08-25T09:42:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 --2- 172.21.15.89:0/186087736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5500b39a0 0x7fc550069ed0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 --2- 172.21.15.89:0/186087736 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500bc890 0x7fc5500bfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 -- 172.21.15.89:0/186087736 >> 172.21.15.89:0/186087736 conn(0x7fc5500a2000 msgr2=0x7fc5500a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:09.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 -- 172.21.15.89:0/186087736 shutdown_connections 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.909+0000 7fc557999640 1 -- 172.21.15.89:0/186087736 wait complete. 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.910+0000 7fc557999640 1 Processor -- start 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.910+0000 7fc557999640 1 -- start start 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.910+0000 7fc557999640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500b39a0 0x7fc55014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.910+0000 7fc557999640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5500bc890 0x7fc55014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc557999640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 0x7fc5500a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc557999640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55014bb80 con 0x7fc55014b510 2023-08-25T09:42:09.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc557999640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501dfc50 con 0x7fc5500bc890 2023-08-25T09:42:09.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc557999640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55014e950 con 0x7fc5500b39a0 2023-08-25T09:42:09.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 0x7fc5500a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 0x7fc5500a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59884/0 (socket says 172.21.15.89:59884) 2023-08-25T09:42:09.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 -- 172.21.15.89:0/4067237606 learned_addr learned my addr 172.21.15.89:0/4067237606 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:09.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555735640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500b39a0 0x7fc55014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc554f34640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5500bc890 0x7fc55014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 -- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500b39a0 msgr2=0x7fc55014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500b39a0 0x7fc55014d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 -- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5500bc890 msgr2=0x7fc55014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:09.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5500bc890 0x7fc55014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:09.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 -- 172.21.15.89:0/4067237606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480094d0 con 0x7fc55014b510 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc555f36640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 0x7fc5500a5950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5480090b0 tx=0x7fc548004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54803e040 con 0x7fc55014b510 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc548039cd0 con 0x7fc55014b510 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55014ec30 con 0x7fc55014b510 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548004270 con 0x7fc55014b510 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.911+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5500a6070 con 0x7fc55014b510 2023-08-25T09:42:09.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.912+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5501dfe00 con 0x7fc55014b510 2023-08-25T09:42:09.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.913+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5480043d0 con 0x7fc55014b510 2023-08-25T09:42:09.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.913+0000 7fc545ffb640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc53406a050 0x7fc53406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:09.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.913+0000 7fc555735640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc53406a050 0x7fc53406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:09.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.913+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5480aae50 con 0x7fc55014b510 2023-08-25T09:42:09.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.914+0000 7fc555735640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc53406a050 0x7fc53406c510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc54c007ed0 tx=0x7fc54c007e60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:09.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:09.917+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5501dfe00 con 0x7fc55014b510 2023-08-25T09:42:10.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.082+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5501dfdc0 con 0x7fc55014b510 2023-08-25T09:42:10.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.083+0000 7fc545ffb640 1 -- 172.21.15.89:0/4067237606 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5480340a0 con 0x7fc55014b510 2023-08-25T09:42:10.090 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:10.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc53406a050 msgr2=0x7fc53406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc53406a050 0x7fc53406c510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc54c007ed0 tx=0x7fc54c007e60 comp rx=0 tx=0).stop 2023-08-25T09:42:10.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 msgr2=0x7fc5500a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 0x7fc5500a5950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5480090b0 tx=0x7fc548004730 comp rx=0 tx=0).stop 2023-08-25T09:42:10.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 shutdown_connections 2023-08-25T09:42:10.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc53406a050 0x7fc53406c510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55014b510 0x7fc5500a5950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5500bc890 0x7fc55014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 --2- 172.21.15.89:0/4067237606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5500b39a0 0x7fc55014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 >> 172.21.15.89:0/4067237606 conn(0x7fc5500a2000 msgr2=0x7fc550146f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 shutdown_connections 2023-08-25T09:42:10.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.085+0000 7fc557999640 1 -- 172.21.15.89:0/4067237606 wait complete. 2023-08-25T09:42:10.098 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:10.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.199+0000 7f2d38a8e640 1 Processor -- start 2023-08-25T09:42:10.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.199+0000 7f2d38a8e640 1 -- start start 2023-08-25T09:42:10.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d38a8e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d340bcf70 0x7f2d340bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d38a8e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2d3414a9a0 0x7f2d3414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d38a8e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340ba300 con 0x7f2d34144560 2023-08-25T09:42:10.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d38a8e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340b9640 con 0x7f2d340bcf70 2023-08-25T09:42:10.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d38a8e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340bcb40 con 0x7f2d3414a9a0 2023-08-25T09:42:10.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d340bcf70 0x7f2d340bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d340bcf70 0x7f2d340bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59900/0 (socket says 172.21.15.89:59900) 2023-08-25T09:42:10.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 -- 172.21.15.89:0/3418111526 learned_addr learned my addr 172.21.15.89:0/3418111526 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:10.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 -- 172.21.15.89:0/3418111526 >> v2:172.21.15.121:3300/0 conn(0x7f2d3414a9a0 msgr2=0x7f2d3414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:10.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 --2- 172.21.15.89:0/3418111526 >> v2:172.21.15.121:3300/0 conn(0x7f2d3414a9a0 0x7f2d3414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 -- 172.21.15.89:0/3418111526 >> v1:172.21.15.121:6789/0 conn(0x7f2d34144560 legacy=0x7f2d341449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:10.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.200+0000 7f2d3259c640 1 -- 172.21.15.89:0/3418111526 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340bc8c0 con 0x7f2d340bcf70 2023-08-25T09:42:10.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.201+0000 7f2d3259c640 1 --2- 172.21.15.89:0/3418111526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d340bcf70 0x7f2d340bc380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d340bd6b0 tx=0x7f2d2402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347fc3ec8e32a95 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.201+0000 7f2d3159a640 1 -- 172.21.15.89:0/3418111526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2402ca70 con 0x7f2d340bcf70 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.201+0000 7f2d3159a640 1 -- 172.21.15.89:0/3418111526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2402cbd0 con 0x7f2d340bcf70 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.201+0000 7f2d3159a640 1 -- 172.21.15.89:0/3418111526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240343f0 con 0x7f2d340bcf70 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 -- 172.21.15.89:0/3418111526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d340bcf70 msgr2=0x7f2d340bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/3418111526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d340bcf70 0x7f2d340bc380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d340bd6b0 tx=0x7f2d2402bed0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 -- 172.21.15.89:0/3418111526 shutdown_connections 2023-08-25T09:42:10.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/3418111526 >> v2:172.21.15.121:3300/0 conn(0x7f2d3414a9a0 0x7f2d3414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/3418111526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d340bcf70 0x7f2d340bc380 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 -- 172.21.15.89:0/3418111526 >> 172.21.15.89:0/3418111526 conn(0x7f2d340654f0 msgr2=0x7f2d340658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 -- 172.21.15.89:0/3418111526 shutdown_connections 2023-08-25T09:42:10.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.202+0000 7f2d38a8e640 1 -- 172.21.15.89:0/3418111526 wait complete. 2023-08-25T09:42:10.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.203+0000 7f2d38a8e640 1 Processor -- start 2023-08-25T09:42:10.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.203+0000 7f2d38a8e640 1 -- start start 2023-08-25T09:42:10.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d340bcf70 0x7f2d34149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 0x7f2d3414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d3414a9a0 0x7f2d340b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3414a5b0 con 0x7f2d34144560 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34145fd0 con 0x7f2d340bcf70 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34149e90 con 0x7f2d3414a9a0 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 0x7f2d3414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 0x7f2d3414dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59912/0 (socket says 172.21.15.89:59912) 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 -- 172.21.15.89:0/2841791275 learned_addr learned my addr 172.21.15.89:0/2841791275 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d3259c640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d340bcf70 0x7f2d34149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d32d9d640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d3414a9a0 0x7f2d340b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 -- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d3414a9a0 msgr2=0x7f2d340b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d3414a9a0 0x7f2d340b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 -- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d340bcf70 msgr2=0x7f2d34149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d340bcf70 0x7f2d34149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 -- 172.21.15.89:0/2841791275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009b30 con 0x7f2d34144560 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d32d9d640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d3414a9a0 0x7f2d340b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d3259c640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d340bcf70 0x7f2d34149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d31d9b640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 0x7f2d3414dd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c400 tx=0x7f2d2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28011790 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28011930 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d34147440 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28011ce0 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.204+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d34147b90 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.205+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3414b450 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.206+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d2801c460 con 0x7f2d34144560 2023-08-25T09:42:10.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.206+0000 7f2d22ffd640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2d1406a050 0x7f2d1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.206+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d28088550 con 0x7f2d34144560 2023-08-25T09:42:10.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.206+0000 7f2d3259c640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2d1406a050 0x7f2d1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.207+0000 7f2d3259c640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2d1406a050 0x7f2d1406c510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d24035000 tx=0x7f2d24030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.210+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2d28053c40 con 0x7f2d34144560 2023-08-25T09:42:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.376+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d34147db0 con 0x7f2d34144560 2023-08-25T09:42:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.377+0000 7f2d22ffd640 1 -- 172.21.15.89:0/2841791275 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d28057260 con 0x7f2d34144560 2023-08-25T09:42:10.380 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:10.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2d1406a050 msgr2=0x7f2d1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2d1406a050 0x7f2d1406c510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d24035000 tx=0x7f2d24030000 comp rx=0 tx=0).stop 2023-08-25T09:42:10.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 msgr2=0x7f2d3414dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 0x7f2d3414dd50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c400 tx=0x7f2d2800c8c0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 shutdown_connections 2023-08-25T09:42:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2d1406a050 0x7f2d1406c510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d34144560 0x7f2d3414dd50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d3414a9a0 0x7f2d340b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 --2- 172.21.15.89:0/2841791275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d340bcf70 0x7f2d34149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 >> 172.21.15.89:0/2841791275 conn(0x7f2d340654f0 msgr2=0x7f2d34140c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 shutdown_connections 2023-08-25T09:42:10.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.379+0000 7f2d38a8e640 1 -- 172.21.15.89:0/2841791275 wait complete. 2023-08-25T09:42:10.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:10.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.491+0000 7fc10fc21640 1 Processor -- start 2023-08-25T09:42:10.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.491+0000 7fc10fc21640 1 -- start start 2023-08-25T09:42:10.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10fc21640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc108142bd0 0x7fc10806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10fc21640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc10806dd00 0x7fc10814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10fc21640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc108142fb0 con 0x7fc10806e160 2023-08-25T09:42:10.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10fc21640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10806f0e0 con 0x7fc10806dd00 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10fc21640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10806e840 con 0x7fc108142bd0 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc10806dd00 0x7fc10814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc10806dd00 0x7fc10814c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59926/0 (socket says 172.21.15.89:59926) 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 -- 172.21.15.89:0/2757488236 learned_addr learned my addr 172.21.15.89:0/2757488236 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10e1be640 1 --1- 172.21.15.89:0/2757488236 >> v1:172.21.15.89:6789/0 conn(0x7fc10806e160 0x7fc108148790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55900/0 (socket says 172.21.15.89:55900) 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d9bd640 1 --2- 172.21.15.89:0/2757488236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc108142bd0 0x7fc10806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 -- 172.21.15.89:0/2757488236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc108142bd0 msgr2=0x7fc10806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:10.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 --2- 172.21.15.89:0/2757488236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc108142bd0 0x7fc10806d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 -- 172.21.15.89:0/2757488236 >> v1:172.21.15.89:6789/0 conn(0x7fc10806e160 legacy=0x7fc108148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10d1bc640 1 -- 172.21.15.89:0/2757488236 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10806eb20 con 0x7fc10806dd00 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.492+0000 7fc10c9bb640 1 -- 172.21.15.89:0/2757488236 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646420360 0 0) 0x7fc0f8001110 con 0x7fc10806e160 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.493+0000 7fc10d1bc640 1 --2- 172.21.15.89:0/2757488236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc10814c0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009870 tx=0x7fc0fc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd619409acfedff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.493+0000 7fc10c9bb640 1 -- 172.21.15.89:0/2757488236 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc02f840 con 0x7fc10806dd00 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.493+0000 7fc10c9bb640 1 -- 172.21.15.89:0/2757488236 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc02f9a0 con 0x7fc10806dd00 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.493+0000 7fc10c9bb640 1 -- 172.21.15.89:0/2757488236 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc02fd30 con 0x7fc10806dd00 2023-08-25T09:42:10.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 -- 172.21.15.89:0/2757488236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 msgr2=0x7fc10814c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 --2- 172.21.15.89:0/2757488236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc10814c0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009870 tx=0x7fc0fc02ba20 comp rx=0 tx=0).stop 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 -- 172.21.15.89:0/2757488236 shutdown_connections 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 --2- 172.21.15.89:0/2757488236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc10814c0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 --2- 172.21.15.89:0/2757488236 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc108142bd0 0x7fc10806d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 -- 172.21.15.89:0/2757488236 >> 172.21.15.89:0/2757488236 conn(0x7fc1080babd0 msgr2=0x7fc1080bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 -- 172.21.15.89:0/2757488236 shutdown_connections 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.494+0000 7fc10fc21640 1 -- 172.21.15.89:0/2757488236 wait complete. 2023-08-25T09:42:10.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.495+0000 7fc10fc21640 1 Processor -- start 2023-08-25T09:42:10.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.495+0000 7fc10fc21640 1 -- start start 2023-08-25T09:42:10.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc1081d2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc10806e160 0x7fc10806b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc108142bd0 0x7fc1081e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081d24f0 con 0x7fc10806dd00 2023-08-25T09:42:10.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10806c9d0 con 0x7fc108142bd0 2023-08-25T09:42:10.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081d1320 con 0x7fc10806e160 2023-08-25T09:42:10.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc1081d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc1081d2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59936/0 (socket says 172.21.15.89:59936) 2023-08-25T09:42:10.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 -- 172.21.15.89:0/1599827763 learned_addr learned my addr 172.21.15.89:0/1599827763 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d1bc640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc10806e160 0x7fc10806b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10e1be640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc108142bd0 0x7fc1081e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 -- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc10806e160 msgr2=0x7fc10806b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc10806e160 0x7fc10806b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 -- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc108142bd0 msgr2=0x7fc1081e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc108142bd0 0x7fc1081e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 -- 172.21.15.89:0/1599827763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc0094d0 con 0x7fc10806dd00 2023-08-25T09:42:10.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d1bc640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc10806e160 0x7fc10806b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:10.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10e1be640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc108142bd0 0x7fc1081e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:10.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10d9bd640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc1081d2850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc10000efc0 tx=0x7fc10000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100009e60 con 0x7fc10806dd00 2023-08-25T09:42:10.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10000f040 con 0x7fc10806dd00 2023-08-25T09:42:10.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1081d2d90 con 0x7fc10806dd00 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000146a0 con 0x7fc10806dd00 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.496+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10806c710 con 0x7fc10806dd00 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.497+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1081d2300 con 0x7fc10806dd00 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.498+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc100014800 con 0x7fc10806dd00 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.498+0000 7fc1067fc640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc0f406a050 0x7fc0f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.498+0000 7fc10d1bc640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc0f406a050 0x7fc0f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.498+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc100089330 con 0x7fc10806dd00 2023-08-25T09:42:10.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.498+0000 7fc10d1bc640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc0f406a050 0x7fc0f406c510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc036000 tx=0x7fc0fc039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.502+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc100054ab0 con 0x7fc10806dd00 2023-08-25T09:42:10.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.669+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc10806af40 con 0x7fc10806dd00 2023-08-25T09:42:10.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.669+0000 7fc1067fc640 1 -- 172.21.15.89:0/1599827763 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1000580d0 con 0x7fc10806dd00 2023-08-25T09:42:10.672 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc0f406a050 msgr2=0x7fc0f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc0f406a050 0x7fc0f406c510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc036000 tx=0x7fc0fc039040 comp rx=0 tx=0).stop 2023-08-25T09:42:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 msgr2=0x7fc1081d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc1081d2850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc10000efc0 tx=0x7fc10000c490 comp rx=0 tx=0).stop 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 shutdown_connections 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc0f406a050 0x7fc0f406c510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc108142bd0 0x7fc1081e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.671+0000 7fc10fc21640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc10806e160 0x7fc10806b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.672+0000 7fc10fc21640 1 --2- 172.21.15.89:0/1599827763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc10806dd00 0x7fc1081d2850 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.672+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 >> 172.21.15.89:0/1599827763 conn(0x7fc1080babd0 msgr2=0x7fc10813ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.672+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 shutdown_connections 2023-08-25T09:42:10.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.672+0000 7fc10fc21640 1 -- 172.21.15.89:0/1599827763 wait complete. 2023-08-25T09:42:10.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:10.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.780+0000 7f0eee7f5640 1 Processor -- start 2023-08-25T09:42:10.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.780+0000 7f0eee7f5640 1 -- start start 2023-08-25T09:42:10.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0eee7f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ee8070c00 0x7f0ee8148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0eee7f5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ee80b39e0 0x7f0ee80b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0eee7f5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee80b30d0 con 0x7f0ee80b7340 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0eee7f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee80b8290 con 0x7f0ee8070c00 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0eee7f5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee80b2b10 con 0x7f0ee80b39e0 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ee8070c00 0x7f0ee8148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ee8070c00 0x7f0ee8148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59944/0 (socket says 172.21.15.89:59944) 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 -- 172.21.15.89:0/212431373 learned_addr learned my addr 172.21.15.89:0/212431373 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0eecd92640 1 --2- 172.21.15.89:0/212431373 >> v2:172.21.15.121:3300/0 conn(0x7f0ee80b39e0 0x7f0ee80b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 -- 172.21.15.89:0/212431373 >> v2:172.21.15.121:3300/0 conn(0x7f0ee80b39e0 msgr2=0x7f0ee80b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 --2- 172.21.15.89:0/212431373 >> v2:172.21.15.121:3300/0 conn(0x7f0ee80b39e0 0x7f0ee80b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 -- 172.21.15.89:0/212431373 >> v1:172.21.15.121:6789/0 conn(0x7f0ee80b7340 legacy=0x7f0ee8142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.781+0000 7f0ee7fff640 1 -- 172.21.15.89:0/212431373 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80b2df0 con 0x7f0ee8070c00 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.782+0000 7f0ee7fff640 1 --2- 172.21.15.89:0/212431373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee8070c00 0x7f0ee8148810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80b7ce0 tx=0x7f0ed802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed62541fef7ec5c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.782+0000 7f0ee6ffd640 1 -- 172.21.15.89:0/212431373 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031870 con 0x7f0ee8070c00 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.782+0000 7f0ee6ffd640 1 -- 172.21.15.89:0/212431373 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80319d0 con 0x7f0ee8070c00 2023-08-25T09:42:10.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.782+0000 7f0ee6ffd640 1 -- 172.21.15.89:0/212431373 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031d60 con 0x7f0ee8070c00 2023-08-25T09:42:10.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.782+0000 7f0eee7f5640 1 -- 172.21.15.89:0/212431373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee8070c00 msgr2=0x7f0ee8148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.782+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/212431373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee8070c00 0x7f0ee8148810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80b7ce0 tx=0x7f0ed802b910 comp rx=0 tx=0).stop 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.783+0000 7f0eee7f5640 1 -- 172.21.15.89:0/212431373 shutdown_connections 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.783+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/212431373 >> v2:172.21.15.121:3300/0 conn(0x7f0ee80b39e0 0x7f0ee80b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.783+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/212431373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee8070c00 0x7f0ee8148810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.783+0000 7f0eee7f5640 1 -- 172.21.15.89:0/212431373 >> 172.21.15.89:0/212431373 conn(0x7f0ee8069a30 msgr2=0x7f0ee8069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.783+0000 7f0eee7f5640 1 -- 172.21.15.89:0/212431373 shutdown_connections 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.783+0000 7f0eee7f5640 1 -- 172.21.15.89:0/212431373 wait complete. 2023-08-25T09:42:10.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 Processor -- start 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 -- start start 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee8070c00 0x7f0ee81d5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee80b39e0 0x7f0ee8144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 0x7f0ee81e08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8145aa0 con 0x7f0ee80b7340 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee81d4810 con 0x7f0ee80b39e0 2023-08-25T09:42:10.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eee7f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee81d4c00 con 0x7f0ee8070c00 2023-08-25T09:42:10.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eecd92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 0x7f0ee81e08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eecd92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 0x7f0ee81e08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59952/0 (socket says 172.21.15.89:59952) 2023-08-25T09:42:10.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.784+0000 7f0eecd92640 1 -- 172.21.15.89:0/514430539 learned_addr learned my addr 172.21.15.89:0/514430539 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:10.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eecd92640 1 -- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee8070c00 msgr2=0x7f0ee81d5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eecd92640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee8070c00 0x7f0ee81d5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eecd92640 1 -- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee80b39e0 msgr2=0x7f0ee8144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0ee77fe640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee80b39e0 0x7f0ee8144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eecd92640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee80b39e0 0x7f0ee8144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eecd92640 1 -- 172.21.15.89:0/514430539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80094d0 con 0x7f0ee80b7340 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eecd92640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 0x7f0ee81e08d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007e40 tx=0x7f0ee000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0014620 con 0x7f0ee80b7340 2023-08-25T09:42:10.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000ee90 con 0x7f0ee80b7340 2023-08-25T09:42:10.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee8143670 con 0x7f0ee80b7340 2023-08-25T09:42:10.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00149e0 con 0x7f0ee80b7340 2023-08-25T09:42:10.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.785+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee8143060 con 0x7f0ee80b7340 2023-08-25T09:42:10.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.786+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee81434d0 con 0x7f0ee80b7340 2023-08-25T09:42:10.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.786+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ee0014b40 con 0x7f0ee80b7340 2023-08-25T09:42:10.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.787+0000 7f0ee4ff9640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0ed406a080 0x7f0ed406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:10.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.787+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ee0088f20 con 0x7f0ee80b7340 2023-08-25T09:42:10.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.787+0000 7f0ee7fff640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0ed406a080 0x7f0ed406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:10.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.787+0000 7f0ee7fff640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0ed406a080 0x7f0ed406c540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8036000 tx=0x7f0ed8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:10.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.791+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ee81434d0 con 0x7f0ee80b7340 2023-08-25T09:42:10.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.991+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ee81434d0 con 0x7f0ee80b7340 2023-08-25T09:42:10.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.992+0000 7f0ee4ff9640 1 -- 172.21.15.89:0/514430539 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7f0ee81434d0 con 0x7f0ee80b7340 2023-08-25T09:42:10.994 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:10.995 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0ed406a080 msgr2=0x7f0ed406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0ed406a080 0x7f0ed406c540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8036000 tx=0x7f0ed8030000 comp rx=0 tx=0).stop 2023-08-25T09:42:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 msgr2=0x7f0ee81e08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 0x7f0ee81e08d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007e40 tx=0x7f0ee000e4b0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 shutdown_connections 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0ed406a080 0x7f0ed406c540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ee80b7340 0x7f0ee81e08d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee80b39e0 0x7f0ee8144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 --2- 172.21.15.89:0/514430539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee8070c00 0x7f0ee81d5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:10.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 >> 172.21.15.89:0/514430539 conn(0x7f0ee8069a30 msgr2=0x7f0ee813d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:10.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 shutdown_connections 2023-08-25T09:42:10.998 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:10.993+0000 7f0eee7f5640 1 -- 172.21.15.89:0/514430539 wait complete. 2023-08-25T09:42:11.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:11.105 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 Processor -- start 2023-08-25T09:42:11.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 -- start start 2023-08-25T09:42:11.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc13c144c40 0x7fc13c0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc13c0b6ec0 0x7fc13c0b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c14ddb0 0x7fc13c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13c145020 con 0x7fc13c0b6ec0 2023-08-25T09:42:11.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13c0b9330 con 0x7fc13c144c40 2023-08-25T09:42:11.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.103+0000 7fc1417c2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0bd290 con 0x7fc13c14ddb0 2023-08-25T09:42:11.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc13c0b6ec0 0x7fc13c0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc13c0b6ec0 0x7fc13c0b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59960/0 (socket says 172.21.15.89:59960) 2023-08-25T09:42:11.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 -- 172.21.15.89:0/3528657732 learned_addr learned my addr 172.21.15.89:0/3528657732 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:11.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 -- 172.21.15.89:0/3528657732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c14ddb0 msgr2=0x7fc13c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13b7fe640 1 --2- 172.21.15.89:0/3528657732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c14ddb0 0x7fc13c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13affd640 1 --2- 172.21.15.89:0/3528657732 >> v2:172.21.15.121:3300/0 conn(0x7fc13c144c40 0x7fc13c0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 --2- 172.21.15.89:0/3528657732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c14ddb0 0x7fc13c14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 -- 172.21.15.89:0/3528657732 >> v2:172.21.15.121:3300/0 conn(0x7fc13c144c40 msgr2=0x7fc13c0bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 --2- 172.21.15.89:0/3528657732 >> v2:172.21.15.121:3300/0 conn(0x7fc13c144c40 0x7fc13c0bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.104+0000 7fc13a7fc640 1 -- 172.21.15.89:0/3528657732 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0b8850 con 0x7fc13c0b6ec0 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc13a7fc640 1 --2- 172.21.15.89:0/3528657732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c0b6ec0 0x7fc13c0b7660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc13c06c1a0 tx=0x7fc13002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8a5b8e0cd87ff9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc139ffb640 1 -- 172.21.15.89:0/3528657732 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130031870 con 0x7fc13c0b6ec0 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc139ffb640 1 -- 172.21.15.89:0/3528657732 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300319d0 con 0x7fc13c0b6ec0 2023-08-25T09:42:11.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc139ffb640 1 -- 172.21.15.89:0/3528657732 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130031d60 con 0x7fc13c0b6ec0 2023-08-25T09:42:11.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 -- 172.21.15.89:0/3528657732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c0b6ec0 msgr2=0x7fc13c0b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 --2- 172.21.15.89:0/3528657732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c0b6ec0 0x7fc13c0b7660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc13c06c1a0 tx=0x7fc13002b910 comp rx=0 tx=0).stop 2023-08-25T09:42:11.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 -- 172.21.15.89:0/3528657732 shutdown_connections 2023-08-25T09:42:11.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 --2- 172.21.15.89:0/3528657732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c14ddb0 0x7fc13c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 --2- 172.21.15.89:0/3528657732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c0b6ec0 0x7fc13c0b7660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 --2- 172.21.15.89:0/3528657732 >> v2:172.21.15.121:3300/0 conn(0x7fc13c144c40 0x7fc13c0bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 -- 172.21.15.89:0/3528657732 >> 172.21.15.89:0/3528657732 conn(0x7fc13c0654f0 msgr2=0x7fc13c0658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 -- 172.21.15.89:0/3528657732 shutdown_connections 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.105+0000 7fc1417c2640 1 -- 172.21.15.89:0/3528657732 wait complete. 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.106+0000 7fc1417c2640 1 Processor -- start 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.106+0000 7fc1417c2640 1 -- start start 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc1417c2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c0b6ec0 0x7fc13c1d5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc1417c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc13c144c40 0x7fc13c1dfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc1417c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 0x7fc13c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc1417c2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c1dfad0 con 0x7fc13c14ddb0 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc1417c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c1d6440 con 0x7fc13c144c40 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc1417c2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0be8c0 con 0x7fc13c0b6ec0 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 0x7fc13c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 0x7fc13c0a59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59972/0 (socket says 172.21.15.89:59972) 2023-08-25T09:42:11.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 -- 172.21.15.89:0/412739200 learned_addr learned my addr 172.21.15.89:0/412739200 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13affd640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c0b6ec0 0x7fc13c1d5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13a7fc640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc13c144c40 0x7fc13c1dfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 -- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c0b6ec0 msgr2=0x7fc13c1d5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c0b6ec0 0x7fc13c1d5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 -- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc13c144c40 msgr2=0x7fc13c1dfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc13c144c40 0x7fc13c1dfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.107+0000 7fc13b7fe640 1 -- 172.21.15.89:0/412739200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300094d0 con 0x7fc13c14ddb0 2023-08-25T09:42:11.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.108+0000 7fc13b7fe640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 0x7fc13c0a59c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc13400cc30 tx=0x7fc13400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.108+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13400ce40 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.108+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc134003990 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.108+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc134003d20 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.108+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c0b4980 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.108+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c1d3bb0 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.109+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c073bf0 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.109+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc134003e80 con 0x7fc13c14ddb0 2023-08-25T09:42:11.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.110+0000 7fc1237fe640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc12806a050 0x7fc12806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.110+0000 7fc13affd640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc12806a050 0x7fc12806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.110+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1340888f0 con 0x7fc13c14ddb0 2023-08-25T09:42:11.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.110+0000 7fc13affd640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc12806a050 0x7fc12806c510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00b7e0 tx=0x7fc12c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.114+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc134053fe0 con 0x7fc13c14ddb0 2023-08-25T09:42:11.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.280+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc13c142920 con 0x7fc13c14ddb0 2023-08-25T09:42:11.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.282+0000 7fc1237fe640 1 -- 172.21.15.89:0/412739200 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fc134057600 con 0x7fc13c14ddb0 2023-08-25T09:42:11.285 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:11.285 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:11.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.283+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc12806a050 msgr2=0x7fc12806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.283+0000 7fc1417c2640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc12806a050 0x7fc12806c510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00b7e0 tx=0x7fc12c008040 comp rx=0 tx=0).stop 2023-08-25T09:42:11.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.283+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 msgr2=0x7fc13c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 0x7fc13c0a59c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc13400cc30 tx=0x7fc13400a5c0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 shutdown_connections 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc12806a050 0x7fc12806c510 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc13c14ddb0 0x7fc13c0a59c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc13c144c40 0x7fc13c1dfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 --2- 172.21.15.89:0/412739200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc13c0b6ec0 0x7fc13c1d5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 >> 172.21.15.89:0/412739200 conn(0x7fc13c0654f0 msgr2=0x7fc13c14e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 shutdown_connections 2023-08-25T09:42:11.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.284+0000 7fc1417c2640 1 -- 172.21.15.89:0/412739200 wait complete. 2023-08-25T09:42:11.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:11.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:11.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.397+0000 7f6ff5606640 1 Processor -- start 2023-08-25T09:42:11.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.397+0000 7f6ff5606640 1 -- start start 2023-08-25T09:42:11.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6ff5606640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 0x7f6ff00bfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6ff5606640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff00bd850 con 0x7f6ff00bc890 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6ff5606640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff00badc0 con 0x7f6ff014b510 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6ff5606640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00bf820 con 0x7f6ff00b39a0 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6fee7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6ff00bc890 0x7f6ff01532b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55916/0 (socket says 172.21.15.89:55916) 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6fee7fc640 1 -- 172.21.15.89:0/496871386 learned_addr learned my addr 172.21.15.89:0/496871386 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560385918 0 0) 0x7f6ff00bd850 con 0x7f6ff00bc890 2023-08-25T09:42:11.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd8003520 con 0x7f6ff00bc890 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.398+0000 7f6fef7fe640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 0x7f6ff00bfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3975454713 0 0) 0x7f6fd8003520 con 0x7f6ff00bc890 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 msgr2=0x7f6ff00bfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 0x7f6ff00bfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 >> v1:172.21.15.121:6789/0 conn(0x7f6ff014b510 legacy=0x7f6ff00bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00bed00 con 0x7f6ff00bc890 2023-08-25T09:42:11.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f6fe4001670 con 0x7f6ff00bc890 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 >> v1:172.21.15.89:6789/0 conn(0x7f6ff00bc890 legacy=0x7f6ff01532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6fd8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd80047c0 0x7f6fd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 0x7f6fd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00bf820 con 0x7f6fd80039a0 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd800ba60 con 0x7f6fd80047c0 2023-08-25T09:42:11.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd800bc20 con 0x7f6ff00b39a0 2023-08-25T09:42:11.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6feeffd640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6fd8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fee7fc640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd80047c0 0x7f6fd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6fef7fe640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 0x7f6fd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6feeffd640 1 -- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 msgr2=0x7f6fd8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6feeffd640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff00b39a0 0x7f6fd8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6feeffd640 1 -- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd80047c0 msgr2=0x7f6fd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6feeffd640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd80047c0 0x7f6fd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.399+0000 7f6feeffd640 1 -- 172.21.15.89:0/496871386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8003520 con 0x7f6fd80039a0 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6feeffd640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6fd8003dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0001e20 tx=0x7f6fd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5329b0245f30f3f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0003b70 con 0x7f6fd80039a0 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0003cd0 con 0x7f6fd80039a0 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6fedffb640 1 -- 172.21.15.89:0/496871386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0005310 con 0x7f6fd80039a0 2023-08-25T09:42:11.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6ff5606640 1 -- 172.21.15.89:0/496871386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 msgr2=0x7f6fd8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6ff5606640 1 --2- 172.21.15.89:0/496871386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6fd8003dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0001e20 tx=0x7f6fd80057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.400+0000 7f6fef7fe640 1 -- 172.21.15.89:0/496871386 reap_dead start 2023-08-25T09:42:11.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.401+0000 7f6ff5606640 1 -- 172.21.15.89:0/496871386 shutdown_connections 2023-08-25T09:42:11.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.401+0000 7f6ff5606640 1 -- 172.21.15.89:0/496871386 >> 172.21.15.89:0/496871386 conn(0x7f6ff00a2000 msgr2=0x7f6ff00a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.401+0000 7f6ff5606640 1 -- 172.21.15.89:0/496871386 shutdown_connections 2023-08-25T09:42:11.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.401+0000 7f6ff5606640 1 -- 172.21.15.89:0/496871386 wait complete. 2023-08-25T09:42:11.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 Processor -- start 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 -- start start 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6ff014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ff01e3b80 0x7f6ff014d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff01e4000 0x7f6ff014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff01e3760 con 0x7f6fd80039a0 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff014d3a0 con 0x7f6ff01e3b80 2023-08-25T09:42:11.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6ff5606640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00b9dd0 con 0x7f6ff01e4000 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6feeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6ff014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6feeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6ff014ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59996/0 (socket says 172.21.15.89:59996) 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.402+0000 7f6feeffd640 1 -- 172.21.15.89:0/2045300797 learned_addr learned my addr 172.21.15.89:0/2045300797 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6feeffd640 1 -- 172.21.15.89:0/2045300797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff01e4000 msgr2=0x7f6ff014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6feeffd640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff01e4000 0x7f6ff014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6feeffd640 1 -- 172.21.15.89:0/2045300797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ff01e3b80 msgr2=0x7f6ff014d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6feeffd640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ff01e3b80 0x7f6ff014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6feeffd640 1 -- 172.21.15.89:0/2045300797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff006b200 con 0x7f6fd80039a0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6feeffd640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6ff014ce60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6fe002c020 tx=0x7f6fe00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe003e070 con 0x7f6fd80039a0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0003e40 con 0x7f6fd80039a0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0006d70 con 0x7f6fd80039a0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff01e3380 con 0x7f6fd80039a0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.403+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff014e0a0 con 0x7f6fd80039a0 2023-08-25T09:42:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.404+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00bd760 con 0x7f6fd80039a0 2023-08-25T09:42:11.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.404+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6fe0007030 con 0x7f6fd80039a0 2023-08-25T09:42:11.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.405+0000 7f6fd77fe640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6fdc06a050 0x7f6fdc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.405+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fe00a9cf0 con 0x7f6fd80039a0 2023-08-25T09:42:11.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.405+0000 7f6fee7fc640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6fdc06a050 0x7f6fdc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.405+0000 7f6fee7fc640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6fdc06a050 0x7f6fdc06c510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40011e0 tx=0x7f6fe4001110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.409+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6fe0075470 con 0x7f6fd80039a0 2023-08-25T09:42:11.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.574+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ff014e2c0 con 0x7f6fd80039a0 2023-08-25T09:42:11.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.575+0000 7f6fd77fe640 1 -- 172.21.15.89:0/2045300797 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fe0078a90 con 0x7f6fd80039a0 2023-08-25T09:42:11.578 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:11.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6fdc06a050 msgr2=0x7f6fdc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6fdc06a050 0x7f6fdc06c510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40011e0 tx=0x7f6fe4001110 comp rx=0 tx=0).stop 2023-08-25T09:42:11.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 msgr2=0x7f6ff014ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6ff014ce60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6fe002c020 tx=0x7f6fe00014a0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 shutdown_connections 2023-08-25T09:42:11.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6fdc06a050 0x7f6fdc06c510 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ff01e4000 0x7f6ff014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ff01e3b80 0x7f6ff014d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 --2- 172.21.15.89:0/2045300797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80039a0 0x7f6ff014ce60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 >> 172.21.15.89:0/2045300797 conn(0x7f6ff00a2000 msgr2=0x7f6ff00bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 shutdown_connections 2023-08-25T09:42:11.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.577+0000 7f6ff5606640 1 -- 172.21.15.89:0/2045300797 wait complete. 2023-08-25T09:42:11.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:11.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.693+0000 7f24ab983640 1 Processor -- start 2023-08-25T09:42:11.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 -- start start 2023-08-25T09:42:11.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24a406aad0 0x7f24a406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406f4c0 0x7f24a41447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24a4144cf0 0x7f24a406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40b8480 con 0x7f24a406aad0 2023-08-25T09:42:11.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40b8f70 con 0x7f24a4144cf0 2023-08-25T09:42:11.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24ab983640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40b70c0 con 0x7f24a406f4c0 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24a971f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24a406aad0 0x7f24a406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24a971f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24a406aad0 0x7f24a406ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60004/0 (socket says 172.21.15.89:60004) 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.694+0000 7f24a971f640 1 -- 172.21.15.89:0/3931749653 learned_addr learned my addr 172.21.15.89:0/3931749653 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f24a971f640 1 -- 172.21.15.89:0/3931749653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406f4c0 msgr2=0x7f24a41447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f24a971f640 1 --2- 172.21.15.89:0/3931749653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406f4c0 0x7f24a41447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f24a971f640 1 -- 172.21.15.89:0/3931749653 >> v2:172.21.15.121:3300/0 conn(0x7f24a4144cf0 msgr2=0x7f24a406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f24a971f640 1 --2- 172.21.15.89:0/3931749653 >> v2:172.21.15.121:3300/0 conn(0x7f24a4144cf0 0x7f24a406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f24a971f640 1 -- 172.21.15.89:0/3931749653 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40b8060 con 0x7f24a406aad0 2023-08-25T09:42:11.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f24a971f640 1 --2- 172.21.15.89:0/3931749653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406aad0 0x7f24a406ef80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24a406b520 tx=0x7f249c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855c3c4dbf876b3d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.695+0000 7f2497fff640 1 -- 172.21.15.89:0/3931749653 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0317e0 con 0x7f24a406aad0 2023-08-25T09:42:11.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f2497fff640 1 -- 172.21.15.89:0/3931749653 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c031940 con 0x7f24a406aad0 2023-08-25T09:42:11.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f2497fff640 1 -- 172.21.15.89:0/3931749653 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c031cd0 con 0x7f24a406aad0 2023-08-25T09:42:11.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 -- 172.21.15.89:0/3931749653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406aad0 msgr2=0x7f24a406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 --2- 172.21.15.89:0/3931749653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406aad0 0x7f24a406ef80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24a406b520 tx=0x7f249c02b880 comp rx=0 tx=0).stop 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 -- 172.21.15.89:0/3931749653 shutdown_connections 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 --2- 172.21.15.89:0/3931749653 >> v2:172.21.15.121:3300/0 conn(0x7f24a4144cf0 0x7f24a406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 --2- 172.21.15.89:0/3931749653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406f4c0 0x7f24a41447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 --2- 172.21.15.89:0/3931749653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406aad0 0x7f24a406ef80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 -- 172.21.15.89:0/3931749653 >> 172.21.15.89:0/3931749653 conn(0x7f24a40b91c0 msgr2=0x7f24a40b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 -- 172.21.15.89:0/3931749653 shutdown_connections 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.696+0000 7f24ab983640 1 -- 172.21.15.89:0/3931749653 wait complete. 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.697+0000 7f24ab983640 1 Processor -- start 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.697+0000 7f24ab983640 1 -- start start 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406aad0 0x7f24a414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 0x7f24a414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24a4144cf0 0x7f24a41412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4141800 con 0x7f24a406f4c0 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a414dea0 con 0x7f24a4144cf0 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a414eca0 con 0x7f24a406aad0 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 0x7f24a414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 0x7f24a414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60014/0 (socket says 172.21.15.89:60014) 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 -- 172.21.15.89:0/3842324709 learned_addr learned my addr 172.21.15.89:0/3842324709 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a971f640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406aad0 0x7f24a414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a9f20640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24a4144cf0 0x7f24a41412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 -- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406aad0 msgr2=0x7f24a414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406aad0 0x7f24a414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 -- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24a4144cf0 msgr2=0x7f24a41412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24a4144cf0 0x7f24a41412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 -- 172.21.15.89:0/3842324709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0094d0 con 0x7f24a406f4c0 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a971f640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406aad0 0x7f24a414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a9f20640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24a4144cf0 0x7f24a41412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24a8f1e640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 0x7f24a414a230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f249800ba50 tx=0x7f249800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800cbe0 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800cd60 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a414c440 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.698+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498014680 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.699+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a414b990 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.700+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a414e050 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.700+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f249801d3b0 con 0x7f24a406f4c0 2023-08-25T09:42:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.700+0000 7f2495ffb640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f248806a080 0x7f248806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.700+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2498088470 con 0x7f24a406f4c0 2023-08-25T09:42:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.700+0000 7f24a971f640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f248806a080 0x7f248806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.701+0000 7f24a971f640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f248806a080 0x7f248806c540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f249c036000 tx=0x7f249c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.704+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f24a414e050 con 0x7f24a406f4c0 2023-08-25T09:42:11.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.870+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f24a414e050 con 0x7f24a406f4c0 2023-08-25T09:42:11.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.871+0000 7f2495ffb640 1 -- 172.21.15.89:0/3842324709 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f24a414e050 con 0x7f24a406f4c0 2023-08-25T09:42:11.874 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:11.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f248806a080 msgr2=0x7f248806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f248806a080 0x7f248806c540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f249c036000 tx=0x7f249c03d040 comp rx=0 tx=0).stop 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 msgr2=0x7f24a414a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 0x7f24a414a230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f249800ba50 tx=0x7f249800bf10 comp rx=0 tx=0).stop 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 shutdown_connections 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f248806a080 0x7f248806c540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a406f4c0 0x7f24a414a230 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24a4144cf0 0x7f24a41412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 --2- 172.21.15.89:0/3842324709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24a406aad0 0x7f24a414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 >> 172.21.15.89:0/3842324709 conn(0x7f24a40b91c0 msgr2=0x7f24a4146ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 shutdown_connections 2023-08-25T09:42:11.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.873+0000 7f24ab983640 1 -- 172.21.15.89:0/3842324709 wait complete. 2023-08-25T09:42:11.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:11.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.985+0000 7f31938ec640 1 Processor -- start 2023-08-25T09:42:11.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.986+0000 7f31938ec640 1 -- start start 2023-08-25T09:42:11.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.986+0000 7f31938ec640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f318c0b3460 0x7f318c0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.986+0000 7f31938ec640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b56d0 0x7f318c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:11.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.986+0000 7f31938ec640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0b80c0 con 0x7f318c070d10 2023-08-25T09:42:11.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.986+0000 7f31938ec640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0b83a0 con 0x7f318c0b3460 2023-08-25T09:42:11.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.986+0000 7f31938ec640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b51b0 con 0x7f318c0b56d0 2023-08-25T09:42:11.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f318c0b3460 0x7f318c0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191e89640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b56d0 0x7f318c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:11.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f318c0b3460 0x7f318c0b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:33624/0 (socket says 172.21.15.89:33624) 2023-08-25T09:42:11.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 -- 172.21.15.89:0/3900052475 learned_addr learned my addr 172.21.15.89:0/3900052475 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:11.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3190e87640 1 --1- 172.21.15.89:0/3900052475 >> v1:172.21.15.121:6789/0 conn(0x7f318c070d10 0x7f318c142450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:50088/0 (socket says 172.21.15.89:50088) 2023-08-25T09:42:11.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 -- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b56d0 msgr2=0x7f318c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:11.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 --2- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b56d0 0x7f318c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 -- 172.21.15.89:0/3900052475 >> v1:172.21.15.121:6789/0 conn(0x7f318c070d10 legacy=0x7f318c142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.987+0000 7f3191688640 1 -- 172.21.15.89:0/3900052475 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0b7000 con 0x7f318c0b3460 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.988+0000 7f3191688640 1 --2- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b3460 0x7f318c0b6ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3188009870 tx=0x7f318802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b800f63fae709f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.988+0000 7f3183fff640 1 -- 172.21.15.89:0/3900052475 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318802f840 con 0x7f318c0b3460 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.988+0000 7f3183fff640 1 -- 172.21.15.89:0/3900052475 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318802f9a0 con 0x7f318c0b3460 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.988+0000 7f3183fff640 1 -- 172.21.15.89:0/3900052475 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318802fd30 con 0x7f318c0b3460 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 -- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b3460 msgr2=0x7f318c0b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:11.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 --2- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b3460 0x7f318c0b6ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3188009870 tx=0x7f318802ba20 comp rx=0 tx=0).stop 2023-08-25T09:42:11.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 -- 172.21.15.89:0/3900052475 shutdown_connections 2023-08-25T09:42:11.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 --2- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b56d0 0x7f318c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 --2- 172.21.15.89:0/3900052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b3460 0x7f318c0b6ac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:11.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 -- 172.21.15.89:0/3900052475 >> 172.21.15.89:0/3900052475 conn(0x7f318c069850 msgr2=0x7f318c069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:11.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 -- 172.21.15.89:0/3900052475 shutdown_connections 2023-08-25T09:42:11.997 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.989+0000 7f31938ec640 1 -- 172.21.15.89:0/3900052475 wait complete. 2023-08-25T09:42:11.999 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 Processor -- start 2023-08-25T09:42:12.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 -- start start 2023-08-25T09:42:12.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 0x7f318c0bb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b3460 0x7f318c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b56d0 0x7f318c1dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c14b0b0 con 0x7f318c070d10 2023-08-25T09:42:12.000 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0bcc00 con 0x7f318c0b56d0 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f31938ec640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c1df690 con 0x7f318c0b3460 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f3191688640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 0x7f318c0bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f3191688640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 0x7f318c0bb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60016/0 (socket says 172.21.15.89:60016) 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.990+0000 7f3191688640 1 -- 172.21.15.89:0/3994806252 learned_addr learned my addr 172.21.15.89:0/3994806252 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3190e87640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b3460 0x7f318c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191e89640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b56d0 0x7f318c1dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191688640 1 -- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b3460 msgr2=0x7f318c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191688640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b3460 0x7f318c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191688640 1 -- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b56d0 msgr2=0x7f318c1dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191688640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b56d0 0x7f318c1dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191688640 1 -- 172.21.15.89:0/3994806252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880094d0 con 0x7f318c070d10 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3190e87640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b3460 0x7f318c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3191688640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 0x7f318c0bb170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3188000c00 tx=0x7f31880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318803b040 con 0x7f318c070d10 2023-08-25T09:42:12.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188037c40 con 0x7f318c070d10 2023-08-25T09:42:12.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c1df970 con 0x7f318c070d10 2023-08-25T09:42:12.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188042480 con 0x7f318c070d10 2023-08-25T09:42:12.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.991+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c0bc8b0 con 0x7f318c070d10 2023-08-25T09:42:12.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.992+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c1dfb80 con 0x7f318c070d10 2023-08-25T09:42:12.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.993+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31880425e0 con 0x7f318c070d10 2023-08-25T09:42:12.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.993+0000 7f3181ffb640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f317006a080 0x7f317006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.993+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31880ab640 con 0x7f318c070d10 2023-08-25T09:42:12.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.993+0000 7f3190e87640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f317006a080 0x7f317006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.993+0000 7f3190e87640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f317006a080 0x7f317006c540 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f317c007fd0 tx=0x7f317c007d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:11.997+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3188076d30 con 0x7f318c070d10 2023-08-25T09:42:12.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.161+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f318c04dbd0 con 0x7f318c070d10 2023-08-25T09:42:12.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.161+0000 7f3181ffb640 1 -- 172.21.15.89:0/3994806252 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f318807a350 con 0x7f318c070d10 2023-08-25T09:42:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:12.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f317006a080 msgr2=0x7f317006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f317006a080 0x7f317006c540 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f317c007fd0 tx=0x7f317c007d80 comp rx=0 tx=0).stop 2023-08-25T09:42:12.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 msgr2=0x7f318c0bb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 0x7f318c0bb170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3188000c00 tx=0x7f31880046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 shutdown_connections 2023-08-25T09:42:12.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f317006a080 0x7f317006c540 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f318c0b56d0 0x7f318c1dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f318c0b3460 0x7f318c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 --2- 172.21.15.89:0/3994806252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f318c070d10 0x7f318c0bb170 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 >> 172.21.15.89:0/3994806252 conn(0x7f318c069850 msgr2=0x7f318c1411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:12.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 shutdown_connections 2023-08-25T09:42:12.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.163+0000 7f31938ec640 1 -- 172.21.15.89:0/3994806252 wait complete. 2023-08-25T09:42:12.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:12.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.276+0000 7f48b046a640 1 Processor -- start 2023-08-25T09:42:12.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.276+0000 7f48b046a640 1 -- start start 2023-08-25T09:42:12.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48b046a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f48a814a920 0x7f48a814e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48b046a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48a80bab10 0x7f48a8155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48b046a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80b7fd0 con 0x7f48a80b7bf0 2023-08-25T09:42:12.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48b046a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a814ad40 con 0x7f48a80bab10 2023-08-25T09:42:12.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48b046a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a814eed0 con 0x7f48a814a920 2023-08-25T09:42:12.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48a80bab10 0x7f48a8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48a80bab10 0x7f48a8155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60020/0 (socket says 172.21.15.89:60020) 2023-08-25T09:42:12.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 -- 172.21.15.89:0/2630433558 learned_addr learned my addr 172.21.15.89:0/2630433558 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:12.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48ada05640 1 --2- 172.21.15.89:0/2630433558 >> v2:172.21.15.121:3300/0 conn(0x7f48a814a920 0x7f48a814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 -- 172.21.15.89:0/2630433558 >> v2:172.21.15.121:3300/0 conn(0x7f48a814a920 msgr2=0x7f48a814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:12.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 --2- 172.21.15.89:0/2630433558 >> v2:172.21.15.121:3300/0 conn(0x7f48a814a920 0x7f48a814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 -- 172.21.15.89:0/2630433558 >> v1:172.21.15.89:6789/0 conn(0x7f48a80b7bf0 legacy=0x7f48a806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48ad204640 1 -- 172.21.15.89:0/2630433558 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557179550 0 0) 0x7f48a4001110 con 0x7f48a80b7bf0 2023-08-25T09:42:12.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48aea07640 1 -- 172.21.15.89:0/2630433558 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80b5230 con 0x7f48a80bab10 2023-08-25T09:42:12.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.277+0000 7f48ada05640 1 --2- 172.21.15.89:0/2630433558 >> v2:172.21.15.121:3300/0 conn(0x7f48a814a920 0x7f48a814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:12.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48aea07640 1 --2- 172.21.15.89:0/2630433558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80bab10 0x7f48a8155280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f48a8071a00 tx=0x7f48a002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777470801d3bc7c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48ad204640 1 -- 172.21.15.89:0/2630433558 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a002c9f0 con 0x7f48a80bab10 2023-08-25T09:42:12.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48ad204640 1 -- 172.21.15.89:0/2630433558 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a002cb50 con 0x7f48a80bab10 2023-08-25T09:42:12.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48ad204640 1 -- 172.21.15.89:0/2630433558 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00343f0 con 0x7f48a80bab10 2023-08-25T09:42:12.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 -- 172.21.15.89:0/2630433558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80bab10 msgr2=0x7f48a8155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 --2- 172.21.15.89:0/2630433558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80bab10 0x7f48a8155280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f48a8071a00 tx=0x7f48a002be50 comp rx=0 tx=0).stop 2023-08-25T09:42:12.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 -- 172.21.15.89:0/2630433558 shutdown_connections 2023-08-25T09:42:12.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 --2- 172.21.15.89:0/2630433558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a80bab10 0x7f48a8155280 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 --2- 172.21.15.89:0/2630433558 >> v2:172.21.15.121:3300/0 conn(0x7f48a814a920 0x7f48a814e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 -- 172.21.15.89:0/2630433558 >> 172.21.15.89:0/2630433558 conn(0x7f48a806e560 msgr2=0x7f48a806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:12.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 -- 172.21.15.89:0/2630433558 shutdown_connections 2023-08-25T09:42:12.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.278+0000 7f48b046a640 1 -- 172.21.15.89:0/2630433558 wait complete. 2023-08-25T09:42:12.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.279+0000 7f48b046a640 1 Processor -- start 2023-08-25T09:42:12.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.279+0000 7f48b046a640 1 -- start start 2023-08-25T09:42:12.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48b046a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48a80b7bf0 0x7f48a8147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.291 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48b046a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48a80bab10 0x7f48a8142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48b046a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 0x7f48a81e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48b046a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8147ff0 con 0x7f48a814a920 2023-08-25T09:42:12.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48b046a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8145eb0 con 0x7f48a80bab10 2023-08-25T09:42:12.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48b046a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8147120 con 0x7f48a80b7bf0 2023-08-25T09:42:12.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 0x7f48a81e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 0x7f48a81e33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60024/0 (socket says 172.21.15.89:60024) 2023-08-25T09:42:12.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 -- 172.21.15.89:0/257109626 learned_addr learned my addr 172.21.15.89:0/257109626 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:12.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48ada05640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48a80bab10 0x7f48a8142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48ae206640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48a80b7bf0 0x7f48a8147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 -- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48a80b7bf0 msgr2=0x7f48a8147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48a80b7bf0 0x7f48a8147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 -- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48a80bab10 msgr2=0x7f48a8142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48a80bab10 0x7f48a8142bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.280+0000 7f48aea07640 1 -- 172.21.15.89:0/257109626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009b30 con 0x7f48a814a920 2023-08-25T09:42:12.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.281+0000 7f48aea07640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 0x7f48a81e33e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009e50 tx=0x7f48a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.281+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a003e450 con 0x7f48a814a920 2023-08-25T09:42:12.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.281+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a003e5b0 con 0x7f48a814a920 2023-08-25T09:42:12.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.281+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a81430f0 con 0x7f48a814a920 2023-08-25T09:42:12.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.281+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a003e960 con 0x7f48a814a920 2023-08-25T09:42:12.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.281+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a8145860 con 0x7f48a814a920 2023-08-25T09:42:12.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.282+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a804dc40 con 0x7f48a814a920 2023-08-25T09:42:12.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.282+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f48a003eac0 con 0x7f48a814a920 2023-08-25T09:42:12.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.282+0000 7f489effd640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f488c06a080 0x7f488c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.282+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48a00ab420 con 0x7f48a814a920 2023-08-25T09:42:12.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.282+0000 7f48ae206640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f488c06a080 0x7f488c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.283+0000 7f48ae206640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f488c06a080 0x7f488c06c540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48a4000f60 tx=0x7f48a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.286+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f48a0076ba0 con 0x7f48a814a920 2023-08-25T09:42:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.452+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48a8146040 con 0x7f48a814a920 2023-08-25T09:42:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.453+0000 7f489effd640 1 -- 172.21.15.89:0/257109626 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48a007a1c0 con 0x7f48a814a920 2023-08-25T09:42:12.460 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f488c06a080 msgr2=0x7f488c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f488c06a080 0x7f488c06c540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48a4000f60 tx=0x7f48a4009040 comp rx=0 tx=0).stop 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 msgr2=0x7f48a81e33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 0x7f48a81e33e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009e50 tx=0x7f48a0004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 shutdown_connections 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f488c06a080 0x7f488c06c540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48a814a920 0x7f48a81e33e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48a80bab10 0x7f48a8142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 --2- 172.21.15.89:0/257109626 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48a80b7bf0 0x7f48a8147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 >> 172.21.15.89:0/257109626 conn(0x7f48a806e560 msgr2=0x7f48a80708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:12.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 shutdown_connections 2023-08-25T09:42:12.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.455+0000 7f48b046a640 1 -- 172.21.15.89:0/257109626 wait complete. 2023-08-25T09:42:12.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:12.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 Processor -- start 2023-08-25T09:42:12.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 -- start start 2023-08-25T09:42:12.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00b3250 0x7f8ec00b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ec00ba500 0x7f8ec00b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec00b7c20 con 0x7f8ec00b95e0 2023-08-25T09:42:12.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00b3eb0 con 0x7f8ec00ba500 2023-08-25T09:42:12.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.567+0000 7f8ec5e83640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0148820 con 0x7f8ec00b3250 2023-08-25T09:42:12.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8ec00b95e0 0x7f8ec0148f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55928/0 (socket says 172.21.15.89:55928) 2023-08-25T09:42:12.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebffff640 1 -- 172.21.15.89:0/3920213643 learned_addr learned my addr 172.21.15.89:0/3920213643 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebf7fe640 1 --2- 172.21.15.89:0/3920213643 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00b3250 0x7f8ec00b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebeffd640 1 --2- 172.21.15.89:0/3920213643 >> v2:172.21.15.121:3300/0 conn(0x7f8ec00ba500 0x7f8ec00b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebe7fc640 1 -- 172.21.15.89:0/3920213643 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786778273 0 0) 0x7f8ec00b7c20 con 0x7f8ec00b95e0 2023-08-25T09:42:12.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebe7fc640 1 -- 172.21.15.89:0/3920213643 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea8003520 con 0x7f8ec00b95e0 2023-08-25T09:42:12.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebe7fc640 1 -- 172.21.15.89:0/3920213643 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706463720 0 0) 0x7f8ea8003520 con 0x7f8ec00b95e0 2023-08-25T09:42:12.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/3920213643 >> v2:172.21.15.121:3300/0 conn(0x7f8ec00ba500 msgr2=0x7f8ec00b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:12.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebf7fe640 1 --2- 172.21.15.89:0/3920213643 >> v2:172.21.15.121:3300/0 conn(0x7f8ec00ba500 0x7f8ec00b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/3920213643 >> v1:172.21.15.89:6789/0 conn(0x7f8ec00b95e0 legacy=0x7f8ec0148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/3920213643 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec00ba920 con 0x7f8ec00b3250 2023-08-25T09:42:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.568+0000 7f8ebeffd640 1 --2- 172.21.15.89:0/3920213643 >> v2:172.21.15.121:3300/0 conn(0x7f8ec00ba500 0x7f8ec00b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.569+0000 7f8ebf7fe640 1 --2- 172.21.15.89:0/3920213643 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00b3250 0x7f8ec00b9ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097a0 tx=0x7f8eb002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b870f8411fdb4e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.569+0000 7f8ebe7fc640 1 -- 172.21.15.89:0/3920213643 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80019f0 con 0x7f8ec00b3250 2023-08-25T09:42:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.569+0000 7f8ebe7fc640 1 -- 172.21.15.89:0/3920213643 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb002e050 con 0x7f8ec00b3250 2023-08-25T09:42:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.569+0000 7f8ebe7fc640 1 -- 172.21.15.89:0/3920213643 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0030730 con 0x7f8ec00b3250 2023-08-25T09:42:12.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.569+0000 7f8ec5e83640 1 -- 172.21.15.89:0/3920213643 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00b3250 msgr2=0x7f8ec00b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.569+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/3920213643 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00b3250 0x7f8ec00b9ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097a0 tx=0x7f8eb002b790 comp rx=0 tx=0).stop 2023-08-25T09:42:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.570+0000 7f8ec5e83640 1 -- 172.21.15.89:0/3920213643 shutdown_connections 2023-08-25T09:42:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.570+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/3920213643 >> v2:172.21.15.121:3300/0 conn(0x7f8ec00ba500 0x7f8ec00b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.570+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/3920213643 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00b3250 0x7f8ec00b9ac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.570+0000 7f8ec5e83640 1 -- 172.21.15.89:0/3920213643 >> 172.21.15.89:0/3920213643 conn(0x7f8ec00bab60 msgr2=0x7f8ec00baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.570+0000 7f8ec5e83640 1 -- 172.21.15.89:0/3920213643 shutdown_connections 2023-08-25T09:42:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.570+0000 7f8ec5e83640 1 -- 172.21.15.89:0/3920213643 wait complete. 2023-08-25T09:42:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 Processor -- start 2023-08-25T09:42:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 -- start start 2023-08-25T09:42:12.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 0x7f8ec0140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ec00b95e0 0x7f8ec00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00ba500 0x7f8ec006c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0147e50 con 0x7f8ec00b3250 2023-08-25T09:42:12.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00a3ad0 con 0x7f8ec00b95e0 2023-08-25T09:42:12.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ec5e83640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00b5ef0 con 0x7f8ec00ba500 2023-08-25T09:42:12.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ebf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 0x7f8ec0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.571+0000 7f8ebf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 0x7f8ec0140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60034/0 (socket says 172.21.15.89:60034) 2023-08-25T09:42:12.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/555657178 learned_addr learned my addr 172.21.15.89:0/555657178 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:12.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebeffd640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ec00b95e0 0x7f8ec00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebffff640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00ba500 0x7f8ec006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00ba500 msgr2=0x7f8ec006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00ba500 0x7f8ec006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ec00b95e0 msgr2=0x7f8ec00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ec00b95e0 0x7f8ec00b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 -- 172.21.15.89:0/555657178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4009400 con 0x7f8ec00b3250 2023-08-25T09:42:12.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebffff640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00ba500 0x7f8ec006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:12.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ebf7fe640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 0x7f8ec0140940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0000c00 tx=0x7f8eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb003c880 con 0x7f8ec00b3250 2023-08-25T09:42:12.591 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb003c9e0 con 0x7f8ec00b3250 2023-08-25T09:42:12.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0009400 con 0x7f8ec00b3250 2023-08-25T09:42:12.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb003cd90 con 0x7f8ec00b3250 2023-08-25T09:42:12.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.572+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec0148060 con 0x7f8ec00b3250 2023-08-25T09:42:12.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.573+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec0073bf0 con 0x7f8ec00b3250 2023-08-25T09:42:12.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.574+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8eb0039040 con 0x7f8ec00b3250 2023-08-25T09:42:12.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.574+0000 7f8ea7fff640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8eac06a050 0x7f8eac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.574+0000 7f8ebeffd640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8eac06a050 0x7f8eac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.574+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8eb00aa050 con 0x7f8ec00b3250 2023-08-25T09:42:12.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.574+0000 7f8ebeffd640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8eac06a050 0x7f8eac06c510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ec01e0270 tx=0x7f8eb4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.578+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8eb0075910 con 0x7f8ec00b3250 2023-08-25T09:42:12.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.780+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ec006bde0 con 0x7f8ec00b3250 2023-08-25T09:42:12.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.781+0000 7f8ea7fff640 1 -- 172.21.15.89:0/555657178 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7f8eb0037090 con 0x7f8ec00b3250 2023-08-25T09:42:12.784 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:12.784 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:12.784 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8eac06a050 msgr2=0x7f8eac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8eac06a050 0x7f8eac06c510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ec01e0270 tx=0x7f8eb4009190 comp rx=0 tx=0).stop 2023-08-25T09:42:12.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 msgr2=0x7f8ec0140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 0x7f8ec0140940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0000c00 tx=0x7f8eb00046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 shutdown_connections 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8eac06a050 0x7f8eac06c510 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ec00ba500 0x7f8ec006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ec00b95e0 0x7f8ec00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 --2- 172.21.15.89:0/555657178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec00b3250 0x7f8ec0140940 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 >> 172.21.15.89:0/555657178 conn(0x7f8ec00bab60 msgr2=0x7f8ec01d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:12.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 shutdown_connections 2023-08-25T09:42:12.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.783+0000 7f8ec5e83640 1 -- 172.21.15.89:0/555657178 wait complete. 2023-08-25T09:42:12.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:12.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.896+0000 7f7b45d22640 1 Processor -- start 2023-08-25T09:42:12.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.896+0000 7f7b45d22640 1 -- start start 2023-08-25T09:42:12.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b45d22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b4006f060 0x7f7b40152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b45d22640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400b3040 con 0x7f7b4006fb00 2023-08-25T09:42:12.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b45d22640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400b27a0 con 0x7f7b400b7c10 2023-08-25T09:42:12.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b45d22640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400b2a80 con 0x7f7b4006f060 2023-08-25T09:42:12.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7b4006fb00 0x7f7b40141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55934/0 (socket says 172.21.15.89:55934) 2023-08-25T09:42:12.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3effd640 1 -- 172.21.15.89:0/2870725274 learned_addr learned my addr 172.21.15.89:0/2870725274 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:12.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3ffff640 1 --2- 172.21.15.89:0/2870725274 >> v2:172.21.15.89:3300/0 conn(0x7f7b4006f060 0x7f7b40152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3ffff640 1 -- 172.21.15.89:0/2870725274 >> v1:172.21.15.121:6789/0 conn(0x7f7b400b7c10 legacy=0x7f7b40070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3ffff640 1 -- 172.21.15.89:0/2870725274 >> v1:172.21.15.89:6789/0 conn(0x7f7b4006fb00 legacy=0x7f7b40141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3e7fc640 1 -- 172.21.15.89:0/2870725274 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769195618 0 0) 0x7f7b400b3040 con 0x7f7b4006fb00 2023-08-25T09:42:12.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.897+0000 7f7b3ffff640 1 -- 172.21.15.89:0/2870725274 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400b2d60 con 0x7f7b4006f060 2023-08-25T09:42:12.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.898+0000 7f7b3ffff640 1 --2- 172.21.15.89:0/2870725274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4006f060 0x7f7b40152f60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009d90 tx=0x7f7b3802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e508df733eec2d4f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.898+0000 7f7b3e7fc640 1 -- 172.21.15.89:0/2870725274 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3802cd80 con 0x7f7b4006f060 2023-08-25T09:42:12.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.898+0000 7f7b3e7fc640 1 -- 172.21.15.89:0/2870725274 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38034440 con 0x7f7b4006f060 2023-08-25T09:42:12.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.898+0000 7f7b3e7fc640 1 -- 172.21.15.89:0/2870725274 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b380347d0 con 0x7f7b4006f060 2023-08-25T09:42:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 -- 172.21.15.89:0/2870725274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4006f060 msgr2=0x7f7b40152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 --2- 172.21.15.89:0/2870725274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4006f060 0x7f7b40152f60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009d90 tx=0x7f7b3802bfd0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 -- 172.21.15.89:0/2870725274 shutdown_connections 2023-08-25T09:42:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 --2- 172.21.15.89:0/2870725274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b4006f060 0x7f7b40152f60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 -- 172.21.15.89:0/2870725274 >> 172.21.15.89:0/2870725274 conn(0x7f7b40069a30 msgr2=0x7f7b40069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:12.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 -- 172.21.15.89:0/2870725274 shutdown_connections 2023-08-25T09:42:12.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.899+0000 7f7b45d22640 1 -- 172.21.15.89:0/2870725274 wait complete. 2023-08-25T09:42:12.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 Processor -- start 2023-08-25T09:42:12.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 -- start start 2023-08-25T09:42:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4006f060 0x7f7b4013a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b4006fb00 0x7f7b400b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 0x7f7b400b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4013a7d0 con 0x7f7b400b7c10 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400bb930 con 0x7f7b4006f060 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b45d22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400bbc10 con 0x7f7b4006fb00 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.900+0000 7f7b3ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 0x7f7b400b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 0x7f7b400b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60044/0 (socket says 172.21.15.89:60044) 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 -- 172.21.15.89:0/3150795722 learned_addr learned my addr 172.21.15.89:0/3150795722 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3f7fe640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4006f060 0x7f7b4013a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3effd640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b4006fb00 0x7f7b400b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 -- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b4006fb00 msgr2=0x7f7b400b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b4006fb00 0x7f7b400b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 -- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4006f060 msgr2=0x7f7b4013a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4006f060 0x7f7b4013a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 -- 172.21.15.89:0/3150795722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009a70 con 0x7f7b400b7c10 2023-08-25T09:42:12.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3f7fe640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4006f060 0x7f7b4013a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b3ffff640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 0x7f7b400b6890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009d90 tx=0x7f7b38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38040650 con 0x7f7b400b7c10 2023-08-25T09:42:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b380407b0 con 0x7f7b400b7c10 2023-08-25T09:42:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b40147660 con 0x7f7b400b7c10 2023-08-25T09:42:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38040b60 con 0x7f7b400b7c10 2023-08-25T09:42:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.901+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4013ae50 con 0x7f7b400b7c10 2023-08-25T09:42:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.902+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b40147b80 con 0x7f7b400b7c10 2023-08-25T09:42:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.902+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b38040cc0 con 0x7f7b400b7c10 2023-08-25T09:42:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.903+0000 7f7b27fff640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b2c06a050 0x7f7b2c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.903+0000 7f7b3f7fe640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b2c06a050 0x7f7b2c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.903+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b380ab580 con 0x7f7b400b7c10 2023-08-25T09:42:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.903+0000 7f7b3f7fe640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b2c06a050 0x7f7b2c06c510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b30007fd0 tx=0x7f7b30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:12.907+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b40147b80 con 0x7f7b400b7c10 2023-08-25T09:42:13.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.073+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b40147b80 con 0x7f7b400b7c10 2023-08-25T09:42:13.092 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.075+0000 7f7b27fff640 1 -- 172.21.15.89:0/3150795722 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f7b40147b80 con 0x7f7b400b7c10 2023-08-25T09:42:13.093 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:13.093 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.076+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b2c06a050 msgr2=0x7f7b2c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.076+0000 7f7b45d22640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b2c06a050 0x7f7b2c06c510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b30007fd0 tx=0x7f7b30009040 comp rx=0 tx=0).stop 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.076+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 msgr2=0x7f7b400b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.076+0000 7f7b45d22640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 0x7f7b400b6890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009d90 tx=0x7f7b38004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.076+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 shutdown_connections 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7b2c06a050 0x7f7b2c06c510 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b400b7c10 0x7f7b400b6890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b4006fb00 0x7f7b400b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 --2- 172.21.15.89:0/3150795722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4006f060 0x7f7b4013a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 >> 172.21.15.89:0/3150795722 conn(0x7f7b40069a30 msgr2=0x7f7b400bbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 shutdown_connections 2023-08-25T09:42:13.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.077+0000 7f7b45d22640 1 -- 172.21.15.89:0/3150795722 wait complete. 2023-08-25T09:42:13.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:13.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.200+0000 7f0f10dab640 1 Processor -- start 2023-08-25T09:42:13.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.200+0000 7f0f10dab640 1 -- start start 2023-08-25T09:42:13.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f10dab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c0b7c10 0x7f0f0c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f10dab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f0c070fd0 0x7f0f0c141650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f10dab640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c0b3040 con 0x7f0f0c06fb00 2023-08-25T09:42:13.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f10dab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0b27a0 con 0x7f0f0c070fd0 2023-08-25T09:42:13.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f10dab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0b2a80 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f09d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f0c070fd0 0x7f0f0c141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f09d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f0c070fd0 0x7f0f0c141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60050/0 (socket says 172.21.15.89:60050) 2023-08-25T09:42:13.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f0ad9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0f0c06fb00 0x7f0f0c0b88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55936/0 (socket says 172.21.15.89:55936) 2023-08-25T09:42:13.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.201+0000 7f0f09d9b640 1 -- 172.21.15.89:0/1644123501 learned_addr learned my addr 172.21.15.89:0/1644123501 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f0a59c640 1 --2- 172.21.15.89:0/1644123501 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c0b7c10 0x7f0f0c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f09d9b640 1 -- 172.21.15.89:0/1644123501 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c0b7c10 msgr2=0x7f0f0c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f09d9b640 1 --2- 172.21.15.89:0/1644123501 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c0b7c10 0x7f0f0c070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f09d9b640 1 -- 172.21.15.89:0/1644123501 >> v1:172.21.15.89:6789/0 conn(0x7f0f0c06fb00 legacy=0x7f0f0c0b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f09d9b640 1 -- 172.21.15.89:0/1644123501 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0b2d60 con 0x7f0f0c070fd0 2023-08-25T09:42:13.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f0959a640 1 -- 172.21.15.89:0/1644123501 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237227437 0 0) 0x7f0f0c0b3040 con 0x7f0f0c06fb00 2023-08-25T09:42:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.202+0000 7f0f09d9b640 1 --2- 172.21.15.89:0/1644123501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c070fd0 0x7f0f0c141650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009870 tx=0x7f0efc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fe6d4a597bceeb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f0959a640 1 -- 172.21.15.89:0/1644123501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc02f840 con 0x7f0f0c070fd0 2023-08-25T09:42:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f0959a640 1 -- 172.21.15.89:0/1644123501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc02f9a0 con 0x7f0f0c070fd0 2023-08-25T09:42:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f0959a640 1 -- 172.21.15.89:0/1644123501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc02fd30 con 0x7f0f0c070fd0 2023-08-25T09:42:13.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 -- 172.21.15.89:0/1644123501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c070fd0 msgr2=0x7f0f0c141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 --2- 172.21.15.89:0/1644123501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c070fd0 0x7f0f0c141650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009870 tx=0x7f0efc02ba20 comp rx=0 tx=0).stop 2023-08-25T09:42:13.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 -- 172.21.15.89:0/1644123501 shutdown_connections 2023-08-25T09:42:13.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 --2- 172.21.15.89:0/1644123501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c070fd0 0x7f0f0c141650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 --2- 172.21.15.89:0/1644123501 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c0b7c10 0x7f0f0c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 -- 172.21.15.89:0/1644123501 >> 172.21.15.89:0/1644123501 conn(0x7f0f0c069a30 msgr2=0x7f0f0c069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 -- 172.21.15.89:0/1644123501 shutdown_connections 2023-08-25T09:42:13.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.203+0000 7f0f10dab640 1 -- 172.21.15.89:0/1644123501 wait complete. 2023-08-25T09:42:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.204+0000 7f0f10dab640 1 Processor -- start 2023-08-25T09:42:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.204+0000 7f0f10dab640 1 -- start start 2023-08-25T09:42:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f10dab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f0c06fb00 0x7f0f0c0bb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f10dab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c070fd0 0x7f0f0c1e1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f10dab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 0x7f0f0c0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f10dab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0bbae0 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f10dab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c144e40 con 0x7f0f0c06fb00 2023-08-25T09:42:13.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f10dab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1e11e0 con 0x7f0f0c070fd0 2023-08-25T09:42:13.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 0x7f0f0c0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 0x7f0f0c0b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60060/0 (socket says 172.21.15.89:60060) 2023-08-25T09:42:13.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 -- 172.21.15.89:0/2088703692 learned_addr learned my addr 172.21.15.89:0/2088703692 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0a59c640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f0c06fb00 0x7f0f0c0bb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f09d9b640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c070fd0 0x7f0f0c1e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 -- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c070fd0 msgr2=0x7f0f0c1e1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c070fd0 0x7f0f0c1e1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 -- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f0c06fb00 msgr2=0x7f0f0c0bb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f0c06fb00 0x7f0f0c0bb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 -- 172.21.15.89:0/2088703692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0094d0 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f09d9b640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c070fd0 0x7f0f0c1e1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f0ad9d640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 0x7f0f0c0b51d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400c780 tx=0x7f0f0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.205+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400ce90 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.206+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400a640 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.206+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c145df0 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.206+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400aa70 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.206+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c144b60 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.207+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c0b7280 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.207+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f0400abd0 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.207+0000 7f0f02ffd640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0eec06a080 0x7f0eec06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.207+0000 7f0f0a59c640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0eec06a080 0x7f0eec06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.207+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f04087ca0 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.208+0000 7f0f0a59c640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0eec06a080 0x7f0eec06c540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4006fd0 tx=0x7f0ef4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.212+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0f04053420 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.413+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f0c0b8ce0 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.413+0000 7f0f02ffd640 1 -- 172.21.15.89:0/2088703692 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7f0f04018020 con 0x7f0f0c0b7c10 2023-08-25T09:42:13.422 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:13.422 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:13.423 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:13.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0eec06a080 msgr2=0x7f0eec06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0eec06a080 0x7f0eec06c540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4006fd0 tx=0x7f0ef4008040 comp rx=0 tx=0).stop 2023-08-25T09:42:13.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 msgr2=0x7f0f0c0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 0x7f0f0c0b51d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400c780 tx=0x7f0f0400cc40 comp rx=0 tx=0).stop 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 shutdown_connections 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0eec06a080 0x7f0eec06c540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f0c0b7c10 0x7f0f0c0b51d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f0c070fd0 0x7f0f0c1e1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 --2- 172.21.15.89:0/2088703692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f0c06fb00 0x7f0f0c0bb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.415+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 >> 172.21.15.89:0/2088703692 conn(0x7f0f0c069a30 msgr2=0x7f0f0c0b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.416+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 shutdown_connections 2023-08-25T09:42:13.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.416+0000 7f0f10dab640 1 -- 172.21.15.89:0/2088703692 wait complete. 2023-08-25T09:42:13.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T09:42:00.621769+0000', 'modified': '2023-08-25T09:42:03.271371+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6837/2092474758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 2092474758}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 2092474758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T09:42:13.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T09:42:13.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T09:42:13.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.833+0000 7fc58ddab640 1 Processor -- start 2023-08-25T09:42:13.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.833+0000 7fc58ddab640 1 -- start start 2023-08-25T09:42:13.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc58ddab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 0x7fc5880b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc58ddab640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc58814a9e0 0x7fc58814b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc58ddab640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58814ae20 con 0x7fc58814b680 2023-08-25T09:42:13.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc58ddab640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58806c9b0 con 0x7fc58814a9e0 2023-08-25T09:42:13.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc58ddab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b52a0 con 0x7fc58806abd0 2023-08-25T09:42:13.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc587fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc58814b680 0x7fc58814dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55938/0 (socket says 172.21.15.89:55938) 2023-08-25T09:42:13.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc587fff640 1 -- 172.21.15.89:0/2229503510 learned_addr learned my addr 172.21.15.89:0/2229503510 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:13.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc586ffd640 1 --2- 172.21.15.89:0/2229503510 >> v2:172.21.15.121:3300/0 conn(0x7fc58814a9e0 0x7fc58814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5877fe640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 0x7fc5880b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472016241 0 0) 0x7fc58814ae20 con 0x7fc58814b680 2023-08-25T09:42:13.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc570003520 con 0x7fc58814b680 2023-08-25T09:42:13.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1668084691 0 0) 0x7fc570003520 con 0x7fc58814b680 2023-08-25T09:42:13.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 msgr2=0x7fc5880b96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 0x7fc5880b96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 >> v2:172.21.15.121:3300/0 conn(0x7fc58814a9e0 msgr2=0x7fc58814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 --2- 172.21.15.89:0/2229503510 >> v2:172.21.15.121:3300/0 conn(0x7fc58814a9e0 0x7fc58814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880b4fc0 con 0x7fc58814b680 2023-08-25T09:42:13.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fc5800019f0 con 0x7fc58814b680 2023-08-25T09:42:13.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 >> v1:172.21.15.89:6789/0 conn(0x7fc58814b680 legacy=0x7fc58814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc570003a10 0x7fc570003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 0x7fc5700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc570005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58806c9b0 con 0x7fc570004d00 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b52a0 con 0x7fc570003a10 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.834+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57000b980 con 0x7fc58806abd0 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc587fff640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc570005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc5877fe640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc570003a10 0x7fc570003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc586ffd640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 0x7fc5700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc587fff640 1 -- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 msgr2=0x7fc5700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc587fff640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc58806abd0 0x7fc5700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc587fff640 1 -- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc570003a10 msgr2=0x7fc570003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc587fff640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc570003a10 0x7fc570003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.835+0000 7fc587fff640 1 -- 172.21.15.89:0/2229503510 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570003520 con 0x7fc570004d00 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc587fff640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc570005180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc58000a800 tx=0x7fc5700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c86bd2f91de821 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800072d0 con 0x7fc570004d00 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58002f070 con 0x7fc570004d00 2023-08-25T09:42:13.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc5867fc640 1 -- 172.21.15.89:0/2229503510 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580007690 con 0x7fc570004d00 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc58ddab640 1 -- 172.21.15.89:0/2229503510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 msgr2=0x7fc570005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc58ddab640 1 --2- 172.21.15.89:0/2229503510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc570005180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc58000a800 tx=0x7fc5700057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc587fff640 1 -- 172.21.15.89:0/2229503510 reap_dead start 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc58ddab640 1 -- 172.21.15.89:0/2229503510 shutdown_connections 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc58ddab640 1 -- 172.21.15.89:0/2229503510 >> 172.21.15.89:0/2229503510 conn(0x7fc5880bab60 msgr2=0x7fc5880baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc58ddab640 1 -- 172.21.15.89:0/2229503510 shutdown_connections 2023-08-25T09:42:13.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.836+0000 7fc58ddab640 1 -- 172.21.15.89:0/2229503510 wait complete. 2023-08-25T09:42:13.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.837+0000 7fc58ddab640 1 Processor -- start 2023-08-25T09:42:13.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.837+0000 7fc58ddab640 1 -- start start 2023-08-25T09:42:13.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc58ddab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc5881e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc58ddab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5881480e0 0x7fc5881472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc58ddab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5880b75b0 0x7fc5881df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc58ddab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881d1360 con 0x7fc570004d00 2023-08-25T09:42:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc58ddab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881d1200 con 0x7fc5881480e0 2023-08-25T09:42:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc58ddab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881d09f0 con 0x7fc5880b75b0 2023-08-25T09:42:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc5881e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc5881e35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60088/0 (socket says 172.21.15.89:60088) 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 -- 172.21.15.89:0/3595806016 learned_addr learned my addr 172.21.15.89:0/3595806016 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc587fff640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5880b75b0 0x7fc5881df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc586ffd640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5881480e0 0x7fc5881472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 -- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5880b75b0 msgr2=0x7fc5881df4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5880b75b0 0x7fc5881df4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 -- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5881480e0 msgr2=0x7fc5881472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5881480e0 0x7fc5881472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.838+0000 7fc5877fe640 1 -- 172.21.15.89:0/3595806016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588146e30 con 0x7fc570004d00 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.839+0000 7fc5877fe640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc5881e35b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc578011910 tx=0x7fc578011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.839+0000 7fc56ffff640 1 -- 172.21.15.89:0/3595806016 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800faf0 con 0x7fc570004d00 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.839+0000 7fc56ffff640 1 -- 172.21.15.89:0/3595806016 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57800fc50 con 0x7fc570004d00 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.839+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc588143080 con 0x7fc570004d00 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.839+0000 7fc56ffff640 1 -- 172.21.15.89:0/3595806016 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578014440 con 0x7fc570004d00 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.839+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5881d2020 con 0x7fc570004d00 2023-08-25T09:42:13.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.840+0000 7fc56ffff640 1 -- 172.21.15.89:0/3595806016 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5780145a0 con 0x7fc570004d00 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.840+0000 7fc56ffff640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc57406a050 0x7fc57406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.841+0000 7fc56ffff640 1 -- 172.21.15.89:0/3595806016 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc578088d40 con 0x7fc570004d00 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.841+0000 7fc586ffd640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc57406a050 0x7fc57406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.841+0000 7fc586ffd640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc57406a050 0x7fc57406c510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5881dd0f0 tx=0x7fc57c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.841+0000 7fc5909fd740 1 Processor -- start 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.841+0000 7fc5909fd740 1 -- start start 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec3c8a0 0x55625ec6d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec6db10 0x55625ec6df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5909fd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625ebae230 con 0x55625ec78230 2023-08-25T09:42:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625ebab920 con 0x55625ec3c8a0 2023-08-25T09:42:13.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x55625eba7210 con 0x55625ec6db10 2023-08-25T09:42:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec3c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60100/0 (socket says 172.21.15.89:60100) 2023-08-25T09:42:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 -- 172.21.15.89:0/4291408486 learned_addr learned my addr 172.21.15.89:0/4291408486 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 -- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec6db10 msgr2=0x55625ec6df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec6db10 0x55625ec6df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc586ffd640 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec3c8a0 0x55625ec6d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 -- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec3c8a0 msgr2=0x55625ec6d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec3c8a0 0x55625ec6d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.842+0000 7fc5877fe640 1 -- 172.21.15.89:0/4291408486 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55625ebabe80 con 0x55625ec78230 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5877fe640 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec3c360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc5780871c0 tx=0x7fc578057bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5246bd09fb6367a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc56d7fa640 1 -- 172.21.15.89:0/4291408486 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578056520 con 0x55625ec78230 2023-08-25T09:42:13.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc56d7fa640 1 -- 172.21.15.89:0/4291408486 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578054890 con 0x55625ec78230 2023-08-25T09:42:13.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc56d7fa640 1 -- 172.21.15.89:0/4291408486 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57806f340 con 0x55625ec78230 2023-08-25T09:42:13.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 -- 172.21.15.89:0/4291408486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 msgr2=0x55625ec3c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec3c360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc5780871c0 tx=0x7fc578057bf0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 -- 172.21.15.89:0/4291408486 shutdown_connections 2023-08-25T09:42:13.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec6db10 0x55625ec6df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec3c8a0 0x55625ec6d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 --2- 172.21.15.89:0/4291408486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec3c360 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 -- 172.21.15.89:0/4291408486 >> 172.21.15.89:0/4291408486 conn(0x55625ec3dd90 msgr2=0x55625ec77930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.843+0000 7fc5909fd740 1 -- 172.21.15.89:0/4291408486 shutdown_connections 2023-08-25T09:42:13.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.844+0000 7fc5909fd740 1 -- 172.21.15.89:0/4291408486 wait complete. 2023-08-25T09:42:13.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.844+0000 7fc5909fd740 1 -- start start 2023-08-25T09:42:13.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.844+0000 7fc5909fd740 1 Processor -- start 2023-08-25T09:42:13.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ec671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec78230 0x55625ec64940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec64e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625eb46bc0 con 0x55625ec6db10 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625eb46860 con 0x55625ec78230 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x55625eb292a0 con 0x55625ec84560 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ec671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 10 client.0 _ll_register_callbacks cb 0x55625eb5f2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ec671f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60108/0 (socket says 172.21.15.89:60108) 2023-08-25T09:42:13.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 -- 172.21.15.89:0/1004407690 learned_addr learned my addr 172.21.15.89:0/1004407690 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec78230 0x55625ec64940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc587fff640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec64e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 -- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 msgr2=0x55625ec64e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec64e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 -- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec78230 msgr2=0x55625ec64940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec78230 0x55625ec64940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 -- 172.21.15.89:0/1004407690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5881d2020 con 0x55625ec6db10 2023-08-25T09:42:13.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec78230 0x55625ec64940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:13.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ec671f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5780118e0 tx=0x7fc578004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47394078e2c0b14 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5667fc640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-08-25T09:42:13.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5667fc640 1 -- 172.21.15.89:0/1004407690 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57806f320 con 0x55625ec6db10 2023-08-25T09:42:13.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5667fc640 1 -- 172.21.15.89:0/1004407690 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc578057670 con 0x55625ec6db10 2023-08-25T09:42:13.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55625ebceb90 con 0x55625ec6db10 2023-08-25T09:42:13.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5667fc640 1 -- 172.21.15.89:0/1004407690 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc578057830 con 0x55625ec6db10 2023-08-25T09:42:13.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 10 client.4716 fetch_fsmap learned FSMap version 6 2023-08-25T09:42:13.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.845+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55625eba5890 con 0x55625ec6db10 2023-08-25T09:42:13.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5667fc640 1 -- 172.21.15.89:0/1004407690 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55625ebceb90 con 0x55625ec6db10 2023-08-25T09:42:13.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5667fc640 1 -- 172.21.15.89:0/1004407690 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7fc57801b020 con 0x55625ec6db10 2023-08-25T09:42:13.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5909fd740 10 client.4716 fetch_fsmap finished waiting for FSMap version 6 2023-08-25T09:42:13.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5909fd740 10 client.4716 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T09:42:13.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5909fd740 20 client.4716 populate_metadata read hostname 'smithi089' 2023-08-25T09:42:13.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec87be0 0x55625ec87fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5909fd740 4 client.4716 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T09:42:13.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 --> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55625eb7ba90 con 0x55625ec87be0 2023-08-25T09:42:13.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec87be0 0x55625ec87fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec87be0 0x55625ec87fc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5dc5db1f5a886e6 server_cookie=2f5a3ccb5d326932 in_seq=0 out_seq=0 2023-08-25T09:42:13.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.846+0000 7fc5667fc640 10 client.4716 ms_handle_connect on v2:172.21.15.89:6836/2092474758 2023-08-25T09:42:13.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5667fc640 1 -- 172.21.15.89:0/1004407690 <== mds.0 v2:172.21.15.89:6836/2092474758 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55625eb7ba90 con 0x55625ec87be0 2023-08-25T09:42:13.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5667fc640 10 client.4716 handle_command_reply: tid=0 2023-08-25T09:42:13.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 client.4716 shutdown 2023-08-25T09:42:13.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 msgr2=0x55625ec671f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ec671f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5780118e0 tx=0x7fc578004730 comp rx=0 tx=0).stop 2023-08-25T09:42:13.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 shutdown_connections 2023-08-25T09:42:13.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec87be0 0x55625ec87fc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec64e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5667fc640 0 client.4716 ms_handle_reset on v2:172.21.15.89:6836/2092474758 2023-08-25T09:42:13.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec78230 0x55625ec64940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1004407690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ec671f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 >> 172.21.15.89:0/1004407690 conn(0x55625ec3c8a0 msgr2=0x55625ec693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 shutdown_connections 2023-08-25T09:42:13.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 1 -- 172.21.15.89:0/1004407690 wait complete. 2023-08-25T09:42:13.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.847+0000 7fc5909fd740 20 client.4716 trim_cache size 0 max 16384 2023-08-25T09:42:13.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.862+0000 7fc5909fd740 1 Processor -- start 2023-08-25T09:42:13.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.862+0000 7fc5909fd740 1 -- start start 2023-08-25T09:42:13.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec6db10 0x55625ec672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec41160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec6fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5909fd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625ec67820 con 0x55625ec78230 2023-08-25T09:42:13.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625ec37f00 con 0x55625ec6db10 2023-08-25T09:42:13.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x55625ec3c2b0 con 0x55625ec84560 2023-08-25T09:42:13.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec41160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec41160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60116/0 (socket says 172.21.15.89:60116) 2023-08-25T09:42:13.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 -- 172.21.15.89:0/1372552459 learned_addr learned my addr 172.21.15.89:0/1372552459 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec6db10 0x55625ec672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc587fff640 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec6fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 -- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 msgr2=0x55625ec6fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec6fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 -- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec6db10 msgr2=0x55625ec672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec6db10 0x55625ec672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 -- 172.21.15.89:0/1372552459 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55625eb45b90 con 0x55625ec78230 2023-08-25T09:42:13.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec6db10 0x55625ec672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:13.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.863+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec41160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5881467a0 tx=0x7fc57c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f58538d2261ba2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc56dffb640 1 -- 172.21.15.89:0/1372552459 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c02c320 con 0x55625ec78230 2023-08-25T09:42:13.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc56dffb640 1 -- 172.21.15.89:0/1372552459 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c02c480 con 0x55625ec78230 2023-08-25T09:42:13.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc56dffb640 1 -- 172.21.15.89:0/1372552459 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c003d00 con 0x55625ec78230 2023-08-25T09:42:13.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 -- 172.21.15.89:0/1372552459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 msgr2=0x55625ec41160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec41160 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5881467a0 tx=0x7fc57c017000 comp rx=0 tx=0).stop 2023-08-25T09:42:13.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 -- 172.21.15.89:0/1372552459 shutdown_connections 2023-08-25T09:42:13.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec78230 0x55625ec41160 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec84560 0x55625ec6fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1372552459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec6db10 0x55625ec672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 -- 172.21.15.89:0/1372552459 >> 172.21.15.89:0/1372552459 conn(0x55625ec3c8a0 msgr2=0x55625ec971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 -- 172.21.15.89:0/1372552459 shutdown_connections 2023-08-25T09:42:13.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.864+0000 7fc5909fd740 1 -- 172.21.15.89:0/1372552459 wait complete. 2023-08-25T09:42:13.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 -- start start 2023-08-25T09:42:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 Processor -- start 2023-08-25T09:42:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ece0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec78230 0x55625ecd6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec84560 0x55625ecd6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625ecd6fc0 con 0x55625ec6db10 2023-08-25T09:42:13.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x55625ec7ec70 con 0x55625ec84560 2023-08-25T09:42:13.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x55625ecdcce0 con 0x55625ec78230 2023-08-25T09:42:13.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5909fd740 10 client.0 _ll_register_callbacks cb 0x7fc5780544c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T09:42:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ece0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ece0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60118/0 (socket says 172.21.15.89:60118) 2023-08-25T09:42:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.865+0000 7fc5877fe640 1 -- 172.21.15.89:0/1262948530 learned_addr learned my addr 172.21.15.89:0/1262948530 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc587fff640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec84560 0x55625ecd6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec78230 0x55625ecd6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5877fe640 1 -- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec78230 msgr2=0x55625ecd6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec78230 0x55625ecd6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5877fe640 1 -- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec84560 msgr2=0x55625ecd6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec84560 0x55625ecd6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5877fe640 1 -- 172.21.15.89:0/1262948530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c0097d0 con 0x55625ec6db10 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc587fff640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec84560 0x55625ecd6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5877fe640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ece0890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc578057b00 tx=0x7fc578000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2df7ad810a1d6e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:13.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5667fc640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5667fc640 1 -- 172.21.15.89:0/1262948530 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57806f320 con 0x55625ec6db10 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5667fc640 1 -- 172.21.15.89:0/1262948530 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc578062070 con 0x55625ec6db10 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc578054890 con 0x55625ec6db10 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5667fc640 1 -- 172.21.15.89:0/1262948530 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5780762a0 con 0x55625ec6db10 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 10 client.4722 fetch_fsmap learned FSMap version 6 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55625eb6b060 con 0x55625ec6db10 2023-08-25T09:42:13.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5667fc640 1 -- 172.21.15.89:0/1262948530 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578054890 con 0x55625ec6db10 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5667fc640 1 -- 172.21.15.89:0/1262948530 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7fc57805fa50 con 0x55625ec6db10 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 10 client.4722 fetch_fsmap finished waiting for FSMap version 6 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 10 client.4722 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 20 client.4722 populate_metadata read hostname 'smithi089' 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec40110 0x55625ec641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 4 client.4722 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 --> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55625eba01f0 con 0x55625ec40110 2023-08-25T09:42:13.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.866+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec40110 0x55625ec641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5667fc640 10 client.4722 ms_handle_connect on v2:172.21.15.89:6836/2092474758 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc586ffd640 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec40110 0x55625ec641e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33179647d6b90085 server_cookie=ce4e0fe014b39adb in_seq=0 out_seq=0 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5667fc640 1 -- 172.21.15.89:0/1262948530 <== mds.0 v2:172.21.15.89:6836/2092474758 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55625eba01f0 con 0x55625ec40110 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5667fc640 10 client.4722 handle_command_reply: tid=0 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 client.4722 shutdown 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 msgr2=0x55625ece0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ece0890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc578057b00 tx=0x7fc578000bc0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 shutdown_connections 2023-08-25T09:42:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:6836/2092474758,v1:172.21.15.89:6837/2092474758] conn(0x55625ec40110 0x55625ec641e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55625ec84560 0x55625ecd6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55625ec78230 0x55625ecd6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 --2- 172.21.15.89:0/1262948530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55625ec6db10 0x55625ece0890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5667fc640 0 client.4722 ms_handle_reset on v2:172.21.15.89:6836/2092474758 2023-08-25T09:42:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 >> 172.21.15.89:0/1262948530 conn(0x55625ec3c8a0 msgr2=0x55625ec971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 shutdown_connections 2023-08-25T09:42:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 1 -- 172.21.15.89:0/1262948530 wait complete. 2023-08-25T09:42:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.867+0000 7fc5909fd740 20 client.4722 trim_cache size 0 max 16384 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "f41429b4-33b6-4950-8ef3-07360119fda9", 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4302, 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2023-08-25T09:42:13.899 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2023-08-25T09:42:13.900 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 12.604147597000001, 2023-08-25T09:42:13.900 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 6, 2023-08-25T09:42:13.900 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 23, 2023-08-25T09:42:13.900 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 23, 2023-08-25T09:42:13.901 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 17.543217077000001 2023-08-25T09:42:13.901 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-08-25T09:42:13.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc57406a050 msgr2=0x7fc57406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc57406a050 0x7fc57406c510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5881dd0f0 tx=0x7fc57c008040 comp rx=0 tx=0).stop 2023-08-25T09:42:13.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 msgr2=0x7fc5881e35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:13.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc5881e35b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc578011910 tx=0x7fc578011dd0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 shutdown_connections 2023-08-25T09:42:13.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc57406a050 0x7fc57406c510 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5880b75b0 0x7fc5881df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5881480e0 0x7fc5881472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 --2- 172.21.15.89:0/3595806016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc570004d00 0x7fc5881e35b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:13.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 >> 172.21.15.89:0/3595806016 conn(0x7fc5880bab60 msgr2=0x7fc58806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:13.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 shutdown_connections 2023-08-25T09:42:13.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:13.868+0000 7fc58ddab640 1 -- 172.21.15.89:0/3595806016 wait complete. 2023-08-25T09:42:13.906 INFO:teuthology.run_tasks:Running task kclient... 2023-08-25T09:42:13.937 INFO:tasks.kclient:Mounting kernel clients... 2023-08-25T09:42:13.938 INFO:tasks.kclient:config is {'client.0': {}} 2023-08-25T09:42:13.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:13.939 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-08-25T09:42:14.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:14.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-08-25T09:42:14.101 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-08-25T09:42:14.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T09:42:14.107 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-08-25T09:42:14.108 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T09:42:14.109 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:14.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T09:42:14.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.206+0000 7ff3023cf640 1 Processor -- start 2023-08-25T09:42:14.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.206+0000 7ff3023cf640 1 -- start start 2023-08-25T09:42:14.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff3023cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc14a740 0x7ff2fc0654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:14.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff3023cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2fc06efc0 0x7ff2fc155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:14.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff3023cf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc0707d0 con 0x7ff2fc144c00 2023-08-25T09:42:14.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff3023cf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc06aa70 con 0x7ff2fc06efc0 2023-08-25T09:42:14.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff3023cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b6770 con 0x7ff2fc14a740 2023-08-25T09:42:14.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2fc06efc0 0x7ff2fc155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:14.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff2fc06efc0 0x7ff2fc155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60128/0 (socket says 172.21.15.89:60128) 2023-08-25T09:42:14.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff2fbfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff2fc144c00 0x7ff2fc0700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:55948/0 (socket says 172.21.15.89:55948) 2023-08-25T09:42:14.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 -- 172.21.15.89:0/1248637623 learned_addr learned my addr 172.21.15.89:0/1248637623 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:14.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff2fb7fe640 1 --2- 172.21.15.89:0/1248637623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc14a740 0x7ff2fc0654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:14.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 -- 172.21.15.89:0/1248637623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc14a740 msgr2=0x7ff2fc0654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:14.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 --2- 172.21.15.89:0/1248637623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc14a740 0x7ff2fc0654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 -- 172.21.15.89:0/1248637623 >> v1:172.21.15.89:6789/0 conn(0x7ff2fc144c00 legacy=0x7ff2fc0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:14.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.207+0000 7ff30096c640 1 -- 172.21.15.89:0/1248637623 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0b6a50 con 0x7ff2fc06efc0 2023-08-25T09:42:14.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.208+0000 7ff30096c640 1 --2- 172.21.15.89:0/1248637623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc155040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009e50 tx=0x7ff2f402bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d0ccd52742dd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:14.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.208+0000 7ff2faffd640 1 -- 172.21.15.89:0/1248637623 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f402c8c0 con 0x7ff2fc06efc0 2023-08-25T09:42:14.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.208+0000 7ff2faffd640 1 -- 172.21.15.89:0/1248637623 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f402ca20 con 0x7ff2fc06efc0 2023-08-25T09:42:14.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.208+0000 7ff2faffd640 1 -- 172.21.15.89:0/1248637623 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f402cdb0 con 0x7ff2fc06efc0 2023-08-25T09:42:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 -- 172.21.15.89:0/1248637623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc06efc0 msgr2=0x7ff2fc155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 --2- 172.21.15.89:0/1248637623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc155040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009e50 tx=0x7ff2f402bda0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 -- 172.21.15.89:0/1248637623 shutdown_connections 2023-08-25T09:42:14.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 --2- 172.21.15.89:0/1248637623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc155040 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 --2- 172.21.15.89:0/1248637623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc14a740 0x7ff2fc0654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 -- 172.21.15.89:0/1248637623 >> 172.21.15.89:0/1248637623 conn(0x7ff2fc069850 msgr2=0x7ff2fc069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:14.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 -- 172.21.15.89:0/1248637623 shutdown_connections 2023-08-25T09:42:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.209+0000 7ff3023cf640 1 -- 172.21.15.89:0/1248637623 wait complete. 2023-08-25T09:42:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.210+0000 7ff3023cf640 1 Processor -- start 2023-08-25T09:42:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.210+0000 7ff3023cf640 1 -- start start 2023-08-25T09:42:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.210+0000 7ff3023cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.210+0000 7ff3023cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc144c00 0x7ff2fc1d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.210+0000 7ff3023cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 0x7ff2fc1e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff3023cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc147860 con 0x7ff2fc1e3600 2023-08-25T09:42:14.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff3023cf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc1d37d0 con 0x7ff2fc06efc0 2023-08-25T09:42:14.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff3023cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc1d5120 con 0x7ff2fc144c00 2023-08-25T09:42:14.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 0x7ff2fc1e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:14.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 0x7ff2fc1e3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60138/0 (socket says 172.21.15.89:60138) 2023-08-25T09:42:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 -- 172.21.15.89:0/2405389751 learned_addr learned my addr 172.21.15.89:0/2405389751 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff2fbfff640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff2fb7fe640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc144c00 0x7ff2fc1d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 -- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc144c00 msgr2=0x7ff2fc1d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc144c00 0x7ff2fc1d4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 -- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2fc06efc0 msgr2=0x7ff2fc147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 -- 172.21.15.89:0/2405389751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4009b30 con 0x7ff2fc1e3600 2023-08-25T09:42:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff30096c640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 0x7ff2fc1e3a80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009e50 tx=0x7ff2f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4009510 con 0x7ff2fc1e3600 2023-08-25T09:42:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f40079b0 con 0x7ff2fc1e3600 2023-08-25T09:42:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc1e3fc0 con 0x7ff2fc1e3600 2023-08-25T09:42:14.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4007d60 con 0x7ff2fc1e3600 2023-08-25T09:42:14.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.211+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc1d3fa0 con 0x7ff2fc1e3600 2023-08-25T09:42:14.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.212+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc1e3320 con 0x7ff2fc1e3600 2023-08-25T09:42:14.230 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.213+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff2f403e450 con 0x7ff2fc1e3600 2023-08-25T09:42:14.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.213+0000 7ff2f8ff9640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff2e806a080 0x7ff2e806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:14.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.213+0000 7ff2fbfff640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff2e806a080 0x7ff2e806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:14.231 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.213+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2f40aab20 con 0x7ff2fc1e3600 2023-08-25T09:42:14.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.213+0000 7ff2fbfff640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff2e806a080 0x7ff2e806c540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007fd0 tx=0x7ff2ec007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:14.232 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.217+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff2fc1e3320 con 0x7ff2fc1e3600 2023-08-25T09:42:14.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.417+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2fc1d3af0 con 0x7ff2fc1e3600 2023-08-25T09:42:14.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.418+0000 7ff2f8ff9640 1 -- 172.21.15.89:0/2405389751 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2f40762a0 con 0x7ff2fc1e3600 2023-08-25T09:42:14.420 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T09:42:14.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff2e806a080 msgr2=0x7ff2e806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:14.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff2e806a080 0x7ff2e806c540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007fd0 tx=0x7ff2ec007c20 comp rx=0 tx=0).stop 2023-08-25T09:42:14.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 msgr2=0x7ff2fc1e3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:14.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 0x7ff2fc1e3a80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009e50 tx=0x7ff2f4004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:14.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 shutdown_connections 2023-08-25T09:42:14.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff2e806a080 0x7ff2e806c540 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc1e3600 0x7ff2fc1e3a80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2fc144c00 0x7ff2fc1d4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 --2- 172.21.15.89:0/2405389751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2fc06efc0 0x7ff2fc147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:14.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 >> 172.21.15.89:0/2405389751 conn(0x7ff2fc069850 msgr2=0x7ff2fc072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:14.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.419+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 shutdown_connections 2023-08-25T09:42:14.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:14.420+0000 7ff3023cf640 1 -- 172.21.15.89:0/2405389751 wait complete. 2023-08-25T09:42:14.433 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T09:42:14.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T09:42:14.435 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-08-25T09:42:14.435 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T09:42:14.435 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:14.435 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T09:42:14.435 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T09:42:14.435 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T09:42:14.436 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T09:42:14.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:14.436 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-08-25T09:42:14.494 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T09:42:14.494 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T09:42:14.494 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T09:42:14.495 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:14.495 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-08-25T09:42:14.495 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:14.495 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T09:42:14.496 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:14.497 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T09:42:14.497 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:14.497 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T09:42:14.497 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-08-25T09:42:14.497 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2023-08-25T09:42:14.498 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:14.499 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T09:42:14.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:14.500 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-08-25T09:42:14.501 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-08-25T09:42:14.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2023-08-25T09:42:14.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2023-08-25T09:42:14.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2023-08-25T09:42:14.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T09:42:14.502 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-08-25T09:42:15.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:15.005 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T09:42:15.085 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-08-25T09:42:15.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:15.088 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-08-25T09:42:15.137 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-08-25T09:42:15.137 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T09:42:15.137 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T09:42:15.137 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T09:42:15.138 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T09:42:15.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:15.138 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-08-25T09:42:15.139 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-08-25T09:42:15.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T09:42:15.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T09:42:15.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T09:42:15.139 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-08-25T09:42:15.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:15.977 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-08-25T09:42:16.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:16.036 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-08-25T09:42:16.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:16.095 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-08-25T09:42:16.095 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-08-25T09:42:16.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T09:42:16.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-25T09:42:16.096 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-08-25T09:42:16.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-25T09:42:16.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:16.245 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-08-25T09:42:16.246 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-08-25T09:42:16.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-25T09:42:16.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T09:42:16.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-25T09:42:16.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-25T09:42:16.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-25T09:42:16.247 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-08-25T09:42:16.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:16.545 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-08-25T09:42:16.546 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-08-25T09:42:16.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-08-25T09:42:16.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T09:42:16.547 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-08-25T09:42:16.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T09:42:16.715 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:16.764 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T09:42:16.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T09:42:16.764 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:16.859 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-25T09:42:16.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:16.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:16.992 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:16.993 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T09:42:16.993 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-08-25T09:42:17.464 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:17.464 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T09:42:17.465 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-08-25T09:42:17.465 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.121:3300,172.21.15.121:3301" 2023-08-25T09:42:17.465 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T09:42:17.492 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:17.492 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T09:42:17.493 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-08-25T09:42:17.493 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.121:3300,172.21.15.121:3301" 2023-08-25T09:42:17.493 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T09:42:17.493 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.121:6789,172.21.15.121:6790" 2023-08-25T09:42:17.493 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.121:6789,172.21.15.121:6790:/ 2023-08-25T09:42:17.493 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f41429b4-33b6-4950-8ef3-07360119fda9" will pass to kernel 2023-08-25T09:42:17.496 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-25T09:42:17.496 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2023-08-25T09:42:17.497 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-25T09:42:17.497 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2023-08-25T09:42:17.497 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-25T09:42:17.500 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T09:42:17.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:17.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:17.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:17.594 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T09:42:17.659 INFO:teuthology.orchestra.run.smithi149.stdout:client4603 2023-08-25T09:42:17.660 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:42:17.660 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T09:42:17.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:17.725 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T09:42:17.795 INFO:teuthology.orchestra.run.smithi149.stdout:client4603 2023-08-25T09:42:17.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:17.796 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T09:42:17.873 INFO:teuthology.orchestra.run.smithi149.stdout:client4603 2023-08-25T09:42:17.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:17.875 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f41429b4-33b6-4950-8ef3-07360119fda9.client4603/status') 2023-08-25T09:42:17.984 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4603 (3)172.21.15.149:0/4001682169 2023-08-25T09:42:17.985 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2023-08-25T09:42:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2023-08-25T09:42:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2023-08-25T09:42:17.985 INFO:teuthology.orchestra.run.smithi149.stderr:71 bytes copied, 8.2131e-05 s, 864 kB/s 2023-08-25T09:42:17.988 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-25T09:42:18.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:18.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.123+0000 7fc58fa46640 1 Processor -- start 2023-08-25T09:42:18.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58fa46640 1 -- start start 2023-08-25T09:42:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58fa46640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc588144c40 0x7fc5880bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58fa46640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc588145020 con 0x7fc5880b6ec0 2023-08-25T09:42:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58fa46640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880b9330 con 0x7fc58814ddb0 2023-08-25T09:42:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58fa46640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880b7d70 con 0x7fc588144c40 2023-08-25T09:42:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58cfe1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc5880b6ec0 0x7fc5880b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37814/0 (socket says 172.21.15.89:37814) 2023-08-25T09:42:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.124+0000 7fc58cfe1640 1 -- 172.21.15.89:0/3238453821 learned_addr learned my addr 172.21.15.89:0/3238453821 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.125+0000 7fc58d7e2640 1 --2- 172.21.15.89:0/3238453821 >> v2:172.21.15.121:3300/0 conn(0x7fc588144c40 0x7fc5880bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.125+0000 7fc57ffff640 1 -- 172.21.15.89:0/3238453821 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545411131 0 0) 0x7fc588145020 con 0x7fc5880b6ec0 2023-08-25T09:42:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.125+0000 7fc57ffff640 1 -- 172.21.15.89:0/3238453821 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc574003520 con 0x7fc5880b6ec0 2023-08-25T09:42:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.125+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3238453821 >> v1:172.21.15.121:6789/0 conn(0x7fc58814ddb0 legacy=0x7fc5881550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.125+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3238453821 >> v1:172.21.15.89:6789/0 conn(0x7fc5880b6ec0 legacy=0x7fc5880b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.125+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3238453821 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880bd290 con 0x7fc588144c40 2023-08-25T09:42:18.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.126+0000 7fc58d7e2640 1 --2- 172.21.15.89:0/3238453821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588144c40 0x7fc5880bcc70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc5780097a0 tx=0x7fc57802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6dd3843cfc07c8b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.126+0000 7fc57ffff640 1 -- 172.21.15.89:0/3238453821 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578030610 con 0x7fc588144c40 2023-08-25T09:42:18.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.126+0000 7fc57ffff640 1 -- 172.21.15.89:0/3238453821 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578030770 con 0x7fc588144c40 2023-08-25T09:42:18.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.126+0000 7fc57ffff640 1 -- 172.21.15.89:0/3238453821 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578030b00 con 0x7fc588144c40 2023-08-25T09:42:18.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.126+0000 7fc58fa46640 1 -- 172.21.15.89:0/3238453821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588144c40 msgr2=0x7fc5880bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.126+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3238453821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588144c40 0x7fc5880bcc70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc5780097a0 tx=0x7fc57802b960 comp rx=0 tx=0).stop 2023-08-25T09:42:18.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.127+0000 7fc58fa46640 1 -- 172.21.15.89:0/3238453821 shutdown_connections 2023-08-25T09:42:18.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.127+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3238453821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588144c40 0x7fc5880bcc70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.127+0000 7fc58fa46640 1 -- 172.21.15.89:0/3238453821 >> 172.21.15.89:0/3238453821 conn(0x7fc5880654f0 msgr2=0x7fc5880658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.127+0000 7fc58fa46640 1 -- 172.21.15.89:0/3238453821 shutdown_connections 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.127+0000 7fc58fa46640 1 -- 172.21.15.89:0/3238453821 wait complete. 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 Processor -- start 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 -- start start 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 0x7fc5880be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc588144c40 0x7fc5880c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc58814ddb0 0x7fc5880bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b6440 con 0x7fc5880b6ec0 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880c0e50 con 0x7fc58814ddb0 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58fa46640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b5ec0 con 0x7fc588144c40 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58d7e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 0x7fc5880be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58d7e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 0x7fc5880be3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36366/0 (socket says 172.21.15.89:36366) 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3090047874 learned_addr learned my addr 172.21.15.89:0/3090047874 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58dfe3640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc58814ddb0 0x7fc5880bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.128+0000 7fc58cfe1640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc588144c40 0x7fc5880c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc588144c40 msgr2=0x7fc5880c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58d7e2640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc588144c40 0x7fc5880c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc58814ddb0 msgr2=0x7fc5880bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58d7e2640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc58814ddb0 0x7fc5880bebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58d7e2640 1 -- 172.21.15.89:0/3090047874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578009400 con 0x7fc5880b6ec0 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58dfe3640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc58814ddb0 0x7fc5880bebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58d7e2640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 0x7fc5880be3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc57802bf70 tx=0x7fc578004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57803e040 con 0x7fc5880b6ec0 2023-08-25T09:42:18.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578039cb0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5880b61f0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578044630 con 0x7fc5880b6ec0 2023-08-25T09:42:18.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.129+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58814d7d0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.130+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc588073bf0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.131+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc57804d3b0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.131+0000 7fc57dffb640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc56c06a080 0x7fc56c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.131+0000 7fc58cfe1640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc56c06a080 0x7fc56c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.131+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5780aa960 con 0x7fc5880b6ec0 2023-08-25T09:42:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.132+0000 7fc58cfe1640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc56c06a080 0x7fc56c06c540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc58813ee90 tx=0x7fc584009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.135+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5780760e0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.302+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5880bc3d0 con 0x7fc5880b6ec0 2023-08-25T09:42:18.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.303+0000 7fc57dffb640 1 -- 172.21.15.89:0/3090047874 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fc578079700 con 0x7fc5880b6ec0 2023-08-25T09:42:18.305 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:18.306 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:18.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc56c06a080 msgr2=0x7fc56c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc56c06a080 0x7fc56c06c540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc58813ee90 tx=0x7fc584009040 comp rx=0 tx=0).stop 2023-08-25T09:42:18.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 msgr2=0x7fc5880be3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 0x7fc5880be3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc57802bf70 tx=0x7fc578004730 comp rx=0 tx=0).stop 2023-08-25T09:42:18.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 shutdown_connections 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc56c06a080 0x7fc56c06c540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc58814ddb0 0x7fc5880bebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc588144c40 0x7fc5880c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 --2- 172.21.15.89:0/3090047874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5880b6ec0 0x7fc5880be3f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 >> 172.21.15.89:0/3090047874 conn(0x7fc5880654f0 msgr2=0x7fc588142a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 shutdown_connections 2023-08-25T09:42:18.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.305+0000 7fc58fa46640 1 -- 172.21.15.89:0/3090047874 wait complete. 2023-08-25T09:42:18.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:18.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:18.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.422+0000 7f28d4f4e640 1 Processor -- start 2023-08-25T09:42:18.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.422+0000 7f28d4f4e640 1 -- start start 2023-08-25T09:42:18.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28d4f4e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 0x7f28d0141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28d4f4e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f28d0071220 0x7f28d0142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28d4f4e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d006f880 con 0x7f28d00b6900 2023-08-25T09:42:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28d4f4e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d006a760 con 0x7f28d0071220 2023-08-25T09:42:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28d4f4e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b94a0 con 0x7f28d0070660 2023-08-25T09:42:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28ce59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f28d00b6900 0x7f28d0070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37818/0 (socket says 172.21.15.89:37818) 2023-08-25T09:42:18.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28ce59c640 1 -- 172.21.15.89:0/4216579039 learned_addr learned my addr 172.21.15.89:0/4216579039 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:18.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933896934 0 0) 0x7f28d006f880 con 0x7f28d00b6900 2023-08-25T09:42:18.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b8003520 con 0x7f28d00b6900 2023-08-25T09:42:18.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28ced9d640 1 --2- 172.21.15.89:0/4216579039 >> v2:172.21.15.121:3300/0 conn(0x7f28d0071220 0x7f28d0142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.423+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 0x7f28d0141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 417028314 0 0) 0x7f28b8003520 con 0x7f28d00b6900 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 msgr2=0x7f28d0141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 0x7f28d0141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 >> v2:172.21.15.121:3300/0 conn(0x7f28d0071220 msgr2=0x7f28d0142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 --2- 172.21.15.89:0/4216579039 >> v2:172.21.15.121:3300/0 conn(0x7f28d0071220 0x7f28d0142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d006fb20 con 0x7f28d00b6900 2023-08-25T09:42:18.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f28c00019f0 con 0x7f28d00b6900 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 >> v1:172.21.15.89:6789/0 conn(0x7f28d00b6900 legacy=0x7f28d0070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 0x7f28b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28b8004d00 0x7f28b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d006a760 con 0x7f28b8003ef0 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b94a0 con 0x7f28b8004d00 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b800b9d0 con 0x7f28d0070660 2023-08-25T09:42:18.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28ce59c640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 0x7f28b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28ced9d640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28b8004d00 0x7f28b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cdd9b640 1 -- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 msgr2=0x7f28b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d0070660 0x7f28b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cdd9b640 1 -- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28b8004d00 msgr2=0x7f28b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28b8004d00 0x7f28b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.424+0000 7f28cdd9b640 1 -- 172.21.15.89:0/4216579039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8003520 con 0x7f28b8003ef0 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28b80047c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ba30 tx=0x7f28b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc39f69551f33a1a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4032640 con 0x7f28b8003ef0 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c40327a0 con 0x7f28b8003ef0 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28cd59a640 1 -- 172.21.15.89:0/4216579039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4032b30 con 0x7f28b8003ef0 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28d4f4e640 1 -- 172.21.15.89:0/4216579039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 msgr2=0x7f28b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/4216579039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28b80047c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ba30 tx=0x7f28b80057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28ced9d640 1 -- 172.21.15.89:0/4216579039 reap_dead start 2023-08-25T09:42:18.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28d4f4e640 1 -- 172.21.15.89:0/4216579039 shutdown_connections 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28d4f4e640 1 -- 172.21.15.89:0/4216579039 >> 172.21.15.89:0/4216579039 conn(0x7f28d00b9a80 msgr2=0x7f28d00b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28d4f4e640 1 -- 172.21.15.89:0/4216579039 shutdown_connections 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.425+0000 7f28d4f4e640 1 -- 172.21.15.89:0/4216579039 wait complete. 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 Processor -- start 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 -- start start 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28d01dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d01dde10 0x7f28d00b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28d00b2bd0 0x7f28d01477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b3050 con 0x7f28b8003ef0 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0146db0 con 0x7f28d00b2bd0 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28d4f4e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0147090 con 0x7f28d01dde10 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28d01dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28ce59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28d01dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36390/0 (socket says 172.21.15.89:36390) 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28ce59c640 1 -- 172.21.15.89:0/123700674 learned_addr learned my addr 172.21.15.89:0/123700674 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:18.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.427+0000 7f28ce59c640 1 -- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d01dde10 msgr2=0x7f28d00b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28ce59c640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d01dde10 0x7f28d00b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28ce59c640 1 -- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28d00b2bd0 msgr2=0x7f28d01477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28ced9d640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28d00b2bd0 0x7f28d01477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28ce59c640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28d00b2bd0 0x7f28d01477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28ce59c640 1 -- 172.21.15.89:0/123700674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0148d00 con 0x7f28b8003ef0 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28ce59c640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28d01dd8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f28c00079f0 tx=0x7f28c000a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0007ae0 con 0x7f28b8003ef0 2023-08-25T09:42:18.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c000ae40 con 0x7f28b8003ef0 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d0145a80 con 0x7f28b8003ef0 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0013840 con 0x7f28b8003ef0 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.428+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d0148f70 con 0x7f28b8003ef0 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.429+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d004dc40 con 0x7f28b8003ef0 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.429+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f28c00139a0 con 0x7f28b8003ef0 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.430+0000 7f28beffd640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f28b006a050 0x7f28b006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.430+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f28b006a050 0x7f28b006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.430+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28c0089300 con 0x7f28b8003ef0 2023-08-25T09:42:18.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.430+0000 7f28cdd9b640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f28b006a050 0x7f28b006c510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ba00 tx=0x7f28c4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.434+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f28c00549f0 con 0x7f28b8003ef0 2023-08-25T09:42:18.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.601+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28d00b38d0 con 0x7f28b8003ef0 2023-08-25T09:42:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.601+0000 7f28beffd640 1 -- 172.21.15.89:0/123700674 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28c0058010 con 0x7f28b8003ef0 2023-08-25T09:42:18.603 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f28b006a050 msgr2=0x7f28b006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f28b006a050 0x7f28b006c510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ba00 tx=0x7f28c4032000 comp rx=0 tx=0).stop 2023-08-25T09:42:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 msgr2=0x7f28d01dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28d01dd8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f28c00079f0 tx=0x7f28c000a730 comp rx=0 tx=0).stop 2023-08-25T09:42:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 shutdown_connections 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f28b006a050 0x7f28b006c510 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28d00b2bd0 0x7f28d01477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28d01dde10 0x7f28d00b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 --2- 172.21.15.89:0/123700674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28b8003ef0 0x7f28d01dd8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 >> 172.21.15.89:0/123700674 conn(0x7f28d00b9a80 msgr2=0x7f28d006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 shutdown_connections 2023-08-25T09:42:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.603+0000 7f28d4f4e640 1 -- 172.21.15.89:0/123700674 wait complete. 2023-08-25T09:42:18.615 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:18.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.724+0000 7f9af85e1640 1 Processor -- start 2023-08-25T09:42:18.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.724+0000 7f9af85e1640 1 -- start start 2023-08-25T09:42:18.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af85e1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9af00b7bf0 0x7f9af014a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af85e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9af014e990 0x7f9af006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af85e1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af00b7fd0 con 0x7f9af00bab10 2023-08-25T09:42:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af85e1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af00b5230 con 0x7f9af00b7bf0 2023-08-25T09:42:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af85e1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af014def0 con 0x7f9af014e990 2023-08-25T09:42:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af637d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9af00b7bf0 0x7f9af014a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.725+0000 7f9af637d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9af00b7bf0 0x7f9af014a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36400/0 (socket says 172.21.15.89:36400) 2023-08-25T09:42:18.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af637d640 1 -- 172.21.15.89:0/1930054677 learned_addr learned my addr 172.21.15.89:0/1930054677 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:18.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af637d640 1 -- 172.21.15.89:0/1930054677 >> v2:172.21.15.121:3300/0 conn(0x7f9af014e990 msgr2=0x7f9af006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:18.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af5b7c640 1 --2- 172.21.15.89:0/1930054677 >> v2:172.21.15.121:3300/0 conn(0x7f9af014e990 0x7f9af006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af637d640 1 --2- 172.21.15.89:0/1930054677 >> v2:172.21.15.121:3300/0 conn(0x7f9af014e990 0x7f9af006a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af637d640 1 -- 172.21.15.89:0/1930054677 >> v1:172.21.15.121:6789/0 conn(0x7f9af00bab10 legacy=0x7f9af00708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af637d640 1 -- 172.21.15.89:0/1930054677 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af006b180 con 0x7f9af00b7bf0 2023-08-25T09:42:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.726+0000 7f9af637d640 1 --2- 172.21.15.89:0/1930054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af014a920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9af0071a00 tx=0x7f9aec02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ba4449a2ca152e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af537b640 1 -- 172.21.15.89:0/1930054677 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec031750 con 0x7f9af00b7bf0 2023-08-25T09:42:18.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af537b640 1 -- 172.21.15.89:0/1930054677 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0318b0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af537b640 1 -- 172.21.15.89:0/1930054677 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec031c40 con 0x7f9af00b7bf0 2023-08-25T09:42:18.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 -- 172.21.15.89:0/1930054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 msgr2=0x7f9af014a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 --2- 172.21.15.89:0/1930054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af014a920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9af0071a00 tx=0x7f9aec02b7f0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 -- 172.21.15.89:0/1930054677 shutdown_connections 2023-08-25T09:42:18.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 --2- 172.21.15.89:0/1930054677 >> v2:172.21.15.121:3300/0 conn(0x7f9af014e990 0x7f9af006a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 --2- 172.21.15.89:0/1930054677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af014a920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 -- 172.21.15.89:0/1930054677 >> 172.21.15.89:0/1930054677 conn(0x7f9af006e560 msgr2=0x7f9af006e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 -- 172.21.15.89:0/1930054677 shutdown_connections 2023-08-25T09:42:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.727+0000 7f9af85e1640 1 -- 172.21.15.89:0/1930054677 wait complete. 2023-08-25T09:42:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.728+0000 7f9af85e1640 1 Processor -- start 2023-08-25T09:42:18.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.728+0000 7f9af85e1640 1 -- start start 2023-08-25T09:42:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af85e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af01e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af85e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9af00bab10 0x7f9af0149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af85e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af014e990 0x7f9af014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af85e1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01494e0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af85e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af014dba0 con 0x7f9af014e990 2023-08-25T09:42:18.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af85e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af014aa60 con 0x7f9af00bab10 2023-08-25T09:42:18.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af01e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af01e2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36416/0 (socket says 172.21.15.89:36416) 2023-08-25T09:42:18.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 -- 172.21.15.89:0/3344502089 learned_addr learned my addr 172.21.15.89:0/3344502089 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:18.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af6b7e640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af014e990 0x7f9af014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af5b7c640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9af00bab10 0x7f9af0149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 -- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9af00bab10 msgr2=0x7f9af0149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9af00bab10 0x7f9af0149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 -- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af014e990 msgr2=0x7f9af014d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af014e990 0x7f9af014d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 -- 172.21.15.89:0/3344502089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec0094d0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af6b7e640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af014e990 0x7f9af014d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.729+0000 7f9af637d640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af01e2ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9aec02b830 tx=0x7f9aec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.730+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec033c80 con 0x7f9af00b7bf0 2023-08-25T09:42:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.730+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec033de0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.730+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af0149100 con 0x7f9af00b7bf0 2023-08-25T09:42:18.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.730+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec03c620 con 0x7f9af00b7bf0 2023-08-25T09:42:18.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.730+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af0149f10 con 0x7f9af00b7bf0 2023-08-25T09:42:18.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.731+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af014a0a0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.732+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9aec03a040 con 0x7f9af00b7bf0 2023-08-25T09:42:18.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.732+0000 7f9ae6ffd640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ad406a050 0x7f9ad406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:18.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.732+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9aec0aa540 con 0x7f9af00b7bf0 2023-08-25T09:42:18.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.732+0000 7f9af5b7c640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ad406a050 0x7f9ad406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:18.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.732+0000 7f9af5b7c640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ad406a050 0x7f9ad406c510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0006fd0 tx=0x7f9ae0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:18.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.736+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9aec075da0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.901+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9af00b7fd0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.901+0000 7f9ae6ffd640 1 -- 172.21.15.89:0/3344502089 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9af00b7fd0 con 0x7f9af00b7bf0 2023-08-25T09:42:18.908 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:18.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ad406a050 msgr2=0x7f9ad406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ad406a050 0x7f9ad406c510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0006fd0 tx=0x7f9ae0008040 comp rx=0 tx=0).stop 2023-08-25T09:42:18.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 msgr2=0x7f9af01e2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:18.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af01e2ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9aec02b830 tx=0x7f9aec0046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 shutdown_connections 2023-08-25T09:42:18.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ad406a050 0x7f9ad406c510 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af014e990 0x7f9af014d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9af00bab10 0x7f9af0149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 --2- 172.21.15.89:0/3344502089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af00b7bf0 0x7f9af01e2ce0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 >> 172.21.15.89:0/3344502089 conn(0x7f9af006e560 msgr2=0x7f9af01431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 shutdown_connections 2023-08-25T09:42:18.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:18.903+0000 7f9af85e1640 1 -- 172.21.15.89:0/3344502089 wait complete. 2023-08-25T09:42:18.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:19.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.022+0000 7f4ad6142640 1 Processor -- start 2023-08-25T09:42:19.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.022+0000 7f4ad6142640 1 -- start start 2023-08-25T09:42:19.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.022+0000 7f4ad6142640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ad00b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.022+0000 7f4ad6142640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00ba040 con 0x7f4ad0142560 2023-08-25T09:42:19.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.022+0000 7f4ad6142640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad0070740 con 0x7f4ad00b96b0 2023-08-25T09:42:19.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.022+0000 7f4ad6142640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00705b0 con 0x7f4ad00b6890 2023-08-25T09:42:19.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4acffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4ad0142560 0x7f4ad0152fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37830/0 (socket says 172.21.15.89:37830) 2023-08-25T09:42:19.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4acffff640 1 -- 172.21.15.89:0/3121457629 learned_addr learned my addr 172.21.15.89:0/3121457629 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4acf7fe640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ad00b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018499624 0 0) 0x7f4ad00ba040 con 0x7f4ad0142560 2023-08-25T09:42:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab8003520 con 0x7f4ad0142560 2023-08-25T09:42:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243633146 0 0) 0x7f4ad0070740 con 0x7f4ad00b96b0 2023-08-25T09:42:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad00ba040 con 0x7f4ad00b96b0 2023-08-25T09:42:19.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837463637 0 0) 0x7f4ab8003520 con 0x7f4ad0142560 2023-08-25T09:42:19.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 msgr2=0x7f4ad00b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ad00b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 >> v1:172.21.15.121:6789/0 conn(0x7f4ad00b96b0 legacy=0x7f4ad0070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad014bc70 con 0x7f4ad0142560 2023-08-25T09:42:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f4ac80019f0 con 0x7f4ad0142560 2023-08-25T09:42:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4acf7fe640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ad00b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 >> v1:172.21.15.89:6789/0 conn(0x7f4ad0142560 legacy=0x7f4ad0152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ab8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8004070 0x7f4ab80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab8004d00 0x7f4ab8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00705b0 con 0x7f4ab8004d00 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab800ba30 con 0x7f4ab8004070 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab800bbf0 con 0x7f4ad00b6890 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4acffff640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab8004d00 0x7f4ab8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4acf7fe640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ab8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.023+0000 7f4aceffd640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8004070 0x7f4ab80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4acffff640 1 -- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 msgr2=0x7f4ab8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4acffff640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad00b6890 0x7f4ab8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4acffff640 1 -- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8004070 msgr2=0x7f4ab80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4acffff640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8004070 0x7f4ab80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4acffff640 1 -- 172.21.15.89:0/3121457629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009400 con 0x7f4ab8004d00 2023-08-25T09:42:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4acffff640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab8004d00 0x7f4ab8005180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a7a0 tx=0x7f4ab80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2c1e0ea425cd9e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8034630 con 0x7f4ab8004d00 2023-08-25T09:42:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac802f070 con 0x7f4ab8004d00 2023-08-25T09:42:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.024+0000 7f4ace7fc640 1 -- 172.21.15.89:0/3121457629 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80349f0 con 0x7f4ab8004d00 2023-08-25T09:42:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4ad6142640 1 -- 172.21.15.89:0/3121457629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab8004d00 msgr2=0x7f4ab8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4ad6142640 1 --2- 172.21.15.89:0/3121457629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab8004d00 0x7f4ab8005180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a7a0 tx=0x7f4ab80057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4acffff640 1 -- 172.21.15.89:0/3121457629 reap_dead start 2023-08-25T09:42:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4ad6142640 1 -- 172.21.15.89:0/3121457629 shutdown_connections 2023-08-25T09:42:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4ad6142640 1 -- 172.21.15.89:0/3121457629 >> 172.21.15.89:0/3121457629 conn(0x7f4ad006d350 msgr2=0x7f4ad006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4ad6142640 1 -- 172.21.15.89:0/3121457629 shutdown_connections 2023-08-25T09:42:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.025+0000 7f4ad6142640 1 -- 172.21.15.89:0/3121457629 wait complete. 2023-08-25T09:42:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.026+0000 7f4ad6142640 1 Processor -- start 2023-08-25T09:42:19.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.026+0000 7f4ad6142640 1 -- start start 2023-08-25T09:42:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad013a3d0 0x7f4ad01dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad013adf0 0x7f4ad01e03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 0x7f4ad01386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0148de0 con 0x7f4ad0138200 2023-08-25T09:42:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00bb160 con 0x7f4ad013a3d0 2023-08-25T09:42:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01dfa20 con 0x7f4ad013adf0 2023-08-25T09:42:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 0x7f4ad01386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 0x7f4ad01386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36438/0 (socket says 172.21.15.89:36438) 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 -- 172.21.15.89:0/2506179892 learned_addr learned my addr 172.21.15.89:0/2506179892 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acf7fe640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad013a3d0 0x7f4ad01dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4aceffd640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad013adf0 0x7f4ad01e03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 -- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad013adf0 msgr2=0x7f4ad01e03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad013adf0 0x7f4ad01e03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 -- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad013a3d0 msgr2=0x7f4ad01dfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad013a3d0 0x7f4ad01dfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 -- 172.21.15.89:0/2506179892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0138bf0 con 0x7f4ad0138200 2023-08-25T09:42:19.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4acffff640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 0x7f4ad01386b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a8c0 tx=0x7f4ac8001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8034840 con 0x7f4ad0138200 2023-08-25T09:42:19.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac80349a0 con 0x7f4ad0138200 2023-08-25T09:42:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad00bb3b0 con 0x7f4ad0138200 2023-08-25T09:42:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.027+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8034d10 con 0x7f4ad0138200 2023-08-25T09:42:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.028+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad014b540 con 0x7f4ad0138200 2023-08-25T09:42:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.028+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad00712c0 con 0x7f4ad0138200 2023-08-25T09:42:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.029+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ac8031030 con 0x7f4ad0138200 2023-08-25T09:42:19.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.029+0000 7f4ab7fff640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4abc06a080 0x7f4abc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.030+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ac80aa070 con 0x7f4ad0138200 2023-08-25T09:42:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.030+0000 7f4acf7fe640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4abc06a080 0x7f4abc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.030+0000 7f4acf7fe640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4abc06a080 0x7f4abc06c540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d40 tx=0x7f4ac4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.034+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ad00712c0 con 0x7f4ad0138200 2023-08-25T09:42:19.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.198+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ad00712c0 con 0x7f4ad0138200 2023-08-25T09:42:19.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.198+0000 7f4ab7fff640 1 -- 172.21.15.89:0/2506179892 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ad00712c0 con 0x7f4ad0138200 2023-08-25T09:42:19.201 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4abc06a080 msgr2=0x7f4abc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4abc06a080 0x7f4abc06c540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009d40 tx=0x7f4ac4009190 comp rx=0 tx=0).stop 2023-08-25T09:42:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 msgr2=0x7f4ad01386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 0x7f4ad01386b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a8c0 tx=0x7f4ac8001d00 comp rx=0 tx=0).stop 2023-08-25T09:42:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 shutdown_connections 2023-08-25T09:42:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4abc06a080 0x7f4abc06c540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad0138200 0x7f4ad01386b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4ad013adf0 0x7f4ad01e03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 --2- 172.21.15.89:0/2506179892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad013a3d0 0x7f4ad01dfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 >> 172.21.15.89:0/2506179892 conn(0x7f4ad006d350 msgr2=0x7f4ad00b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 shutdown_connections 2023-08-25T09:42:19.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.200+0000 7f4ad6142640 1 -- 172.21.15.89:0/2506179892 wait complete. 2023-08-25T09:42:19.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:19.317 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.316+0000 7f5fe7821640 1 Processor -- start 2023-08-25T09:42:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.316+0000 7f5fe7821640 1 -- start start 2023-08-25T09:42:19.320 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe7821640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 0x7f5fe006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe7821640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5fe014a970 0x7f5fe00b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe7821640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe0069f60 con 0x7f5fe00b68d0 2023-08-25T09:42:19.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe7821640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe00b6cb0 con 0x7f5fe014a970 2023-08-25T09:42:19.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe7821640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe014ae50 con 0x7f5fe00715a0 2023-08-25T09:42:19.321 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe55bd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5fe00b68d0 0x7f5fe0069850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37836/0 (socket says 172.21.15.89:37836) 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe55bd640 1 -- 172.21.15.89:0/3832389707 learned_addr learned my addr 172.21.15.89:0/3832389707 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883165965 0 0) 0x7f5fe0069f60 con 0x7f5fe00b68d0 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe5dbe640 1 --2- 172.21.15.89:0/3832389707 >> v2:172.21.15.121:3300/0 conn(0x7f5fe014a970 0x7f5fe00b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 0x7f5fe006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc003520 con 0x7f5fe00b68d0 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570586791 0 0) 0x7f5fcc003520 con 0x7f5fe00b68d0 2023-08-25T09:42:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 msgr2=0x7f5fe006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 0x7f5fe006fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 >> v2:172.21.15.121:3300/0 conn(0x7f5fe014a970 msgr2=0x7f5fe00b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 --2- 172.21.15.89:0/3832389707 >> v2:172.21.15.121:3300/0 conn(0x7f5fe014a970 0x7f5fe00b9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe014b130 con 0x7f5fe00b68d0 2023-08-25T09:42:19.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f5fdc001690 con 0x7f5fe00b68d0 2023-08-25T09:42:19.323 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 >> v1:172.21.15.89:6789/0 conn(0x7f5fe00b68d0 legacy=0x7f5fe0069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fcc003970 0x7f5fcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fcc0047c0 0x7f5fcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 0x7f5fcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00b6cb0 con 0x7f5fcc0047c0 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe014ae50 con 0x7f5fcc003970 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc00b980 con 0x7f5fe00715a0 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fcc0047c0 0x7f5fcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.317+0000 7f5fe55bd640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fcc003970 0x7f5fcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe5dbe640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 0x7f5fcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 msgr2=0x7f5fcc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe00715a0 0x7f5fcc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fcc003970 msgr2=0x7f5fcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fcc003970 0x7f5fcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/3832389707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc003520 con 0x7f5fcc0047c0 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe55bd640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fcc003970 0x7f5fcc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fcc0047c0 0x7f5fcc004c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009ac0 tx=0x7f5fcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daa286745de1b81 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002c6b0 con 0x7f5fcc0047c0 2023-08-25T09:42:19.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.318+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd002c810 con 0x7f5fcc0047c0 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fd7fff640 1 -- 172.21.15.89:0/3832389707 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002cba0 con 0x7f5fcc0047c0 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe7821640 1 -- 172.21.15.89:0/3832389707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fcc0047c0 msgr2=0x7f5fcc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe7821640 1 --2- 172.21.15.89:0/3832389707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fcc0047c0 0x7f5fcc004c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009ac0 tx=0x7f5fcc0057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe5dbe640 1 -- 172.21.15.89:0/3832389707 reap_dead start 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe7821640 1 -- 172.21.15.89:0/3832389707 shutdown_connections 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe7821640 1 -- 172.21.15.89:0/3832389707 >> 172.21.15.89:0/3832389707 conn(0x7f5fe006d350 msgr2=0x7f5fe006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe7821640 1 -- 172.21.15.89:0/3832389707 shutdown_connections 2023-08-25T09:42:19.333 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.319+0000 7f5fe7821640 1 -- 172.21.15.89:0/3832389707 wait complete. 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.320+0000 7f5fe7821640 1 Processor -- start 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.320+0000 7f5fe7821640 1 -- start start 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fcc0047c0 0x7f5fe01d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 0x7f5fe01e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe01e3890 0x7f5fe0142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01d48b0 con 0x7f5fe0147c50 2023-08-25T09:42:19.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01d0f30 con 0x7f5fe01e3890 2023-08-25T09:42:19.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01480d0 con 0x7f5fcc0047c0 2023-08-25T09:42:19.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 0x7f5fe01e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 0x7f5fe01e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36450/0 (socket says 172.21.15.89:36450) 2023-08-25T09:42:19.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/2245036824 learned_addr learned my addr 172.21.15.89:0/2245036824 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:19.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fcc0047c0 msgr2=0x7f5fe01d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fcc0047c0 0x7f5fe01d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe5dbe640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe01e3890 0x7f5fe0142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe01e3890 msgr2=0x7f5fe0142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe01e3890 0x7f5fe0142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 -- 172.21.15.89:0/2245036824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe01e3cf0 con 0x7f5fe0147c50 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe4dbc640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 0x7f5fe01e3350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fd002c250 tx=0x7f5fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003810 con 0x7f5fe0147c50 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0003970 con 0x7f5fe0147c50 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe01d52a0 con 0x7f5fe0147c50 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.321+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003ce0 con 0x7f5fe0147c50 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.322+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe01d14b0 con 0x7f5fe0147c50 2023-08-25T09:42:19.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.322+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe004dc40 con 0x7f5fe0147c50 2023-08-25T09:42:19.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.323+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fd0047450 con 0x7f5fe0147c50 2023-08-25T09:42:19.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.323+0000 7f5fd5ffb640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5fc406a050 0x7f5fc406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.323+0000 7f5fe55bd640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5fc406a050 0x7f5fc406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.323+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fd00aa6d0 con 0x7f5fe0147c50 2023-08-25T09:42:19.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.324+0000 7f5fe55bd640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5fc406a050 0x7f5fc406c510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001eb0 tx=0x7f5fdc000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.328+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5fd0076020 con 0x7f5fe0147c50 2023-08-25T09:42:19.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.495+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fe006a740 con 0x7f5fe0147c50 2023-08-25T09:42:19.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.496+0000 7f5fd5ffb640 1 -- 172.21.15.89:0/2245036824 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fd00044e0 con 0x7f5fe0147c50 2023-08-25T09:42:19.498 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:19.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5fc406a050 msgr2=0x7f5fc406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5fc406a050 0x7f5fc406c510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001eb0 tx=0x7f5fdc000ed0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 msgr2=0x7f5fe01e3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 0x7f5fe01e3350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fd002c250 tx=0x7f5fd0004730 comp rx=0 tx=0).stop 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 shutdown_connections 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5fc406a050 0x7f5fc406c510 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe0147c50 0x7f5fe01e3350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe01e3890 0x7f5fe0142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 --2- 172.21.15.89:0/2245036824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fcc0047c0 0x7f5fe01d4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.497+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 >> 172.21.15.89:0/2245036824 conn(0x7f5fe006d350 msgr2=0x7f5fe00b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.498+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 shutdown_connections 2023-08-25T09:42:19.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.498+0000 7f5fe7821640 1 -- 172.21.15.89:0/2245036824 wait complete. 2023-08-25T09:42:19.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:19.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.611+0000 7f03c51cf640 1 Processor -- start 2023-08-25T09:42:19.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.611+0000 7f03c51cf640 1 -- start start 2023-08-25T09:42:19.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.611+0000 7f03c51cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03c006fb00 0x7f03c0141650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.611+0000 7f03c51cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0141b90 0x7f03c0151f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.611+0000 7f03c51cf640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00b3040 con 0x7f03c00b7c10 2023-08-25T09:42:19.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03c51cf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00b27a0 con 0x7f03c006fb00 2023-08-25T09:42:19.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03c51cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00b2a80 con 0x7f03c0141b90 2023-08-25T09:42:19.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03c006fb00 0x7f03c0141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03c006fb00 0x7f03c0141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36456/0 (socket says 172.21.15.89:36456) 2023-08-25T09:42:19.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 -- 172.21.15.89:0/270241670 learned_addr learned my addr 172.21.15.89:0/270241670 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:19.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03bf59e640 1 --2- 172.21.15.89:0/270241670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0141b90 0x7f03c0151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 -- 172.21.15.89:0/270241670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0141b90 msgr2=0x7f03c0151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 --2- 172.21.15.89:0/270241670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0141b90 0x7f03c0151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 -- 172.21.15.89:0/270241670 >> v1:172.21.15.121:6789/0 conn(0x7f03c00b7c10 legacy=0x7f03c0070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.612+0000 7f03b7fff640 1 -- 172.21.15.89:0/270241670 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00b2d60 con 0x7f03c006fb00 2023-08-25T09:42:19.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03b7fff640 1 --2- 172.21.15.89:0/270241670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0141650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009870 tx=0x7f03a802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16281cd9ee5c3d65 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03be59c640 1 -- 172.21.15.89:0/270241670 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a802f840 con 0x7f03c006fb00 2023-08-25T09:42:19.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03be59c640 1 -- 172.21.15.89:0/270241670 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a802f9a0 con 0x7f03c006fb00 2023-08-25T09:42:19.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03be59c640 1 -- 172.21.15.89:0/270241670 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a802fd30 con 0x7f03c006fb00 2023-08-25T09:42:19.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 -- 172.21.15.89:0/270241670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 msgr2=0x7f03c0141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 --2- 172.21.15.89:0/270241670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0141650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009870 tx=0x7f03a802ba20 comp rx=0 tx=0).stop 2023-08-25T09:42:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 -- 172.21.15.89:0/270241670 shutdown_connections 2023-08-25T09:42:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 --2- 172.21.15.89:0/270241670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0141b90 0x7f03c0151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 --2- 172.21.15.89:0/270241670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0141650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 -- 172.21.15.89:0/270241670 >> 172.21.15.89:0/270241670 conn(0x7f03c0069a30 msgr2=0x7f03c0069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 -- 172.21.15.89:0/270241670 shutdown_connections 2023-08-25T09:42:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.613+0000 7f03c51cf640 1 -- 172.21.15.89:0/270241670 wait complete. 2023-08-25T09:42:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 Processor -- start 2023-08-25T09:42:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 -- start start 2023-08-25T09:42:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c00b7c10 0x7f03c01494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03c0141b90 0x7f03c0149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01427b0 con 0x7f03c006fb00 2023-08-25T09:42:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0143650 con 0x7f03c0141b90 2023-08-25T09:42:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03c51cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01ddc40 con 0x7f03c00b7c10 2023-08-25T09:42:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03bed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03bed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36470/0 (socket says 172.21.15.89:36470) 2023-08-25T09:42:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03bed9d640 1 -- 172.21.15.89:0/805883025 learned_addr learned my addr 172.21.15.89:0/805883025 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03bf59e640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03c0141b90 0x7f03c0149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.615+0000 7f03b7fff640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c00b7c10 0x7f03c01494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03bed9d640 1 -- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c00b7c10 msgr2=0x7f03c01494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03bed9d640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c00b7c10 0x7f03c01494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03bed9d640 1 -- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03c0141b90 msgr2=0x7f03c0149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03bed9d640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03c0141b90 0x7f03c0149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03bed9d640 1 -- 172.21.15.89:0/805883025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80094d0 con 0x7f03c006fb00 2023-08-25T09:42:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03bed9d640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0142270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c450 tx=0x7f03b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00052d0 con 0x7f03c006fb00 2023-08-25T09:42:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0005430 con 0x7f03c006fb00 2023-08-25T09:42:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c01ddf20 con 0x7f03c006fb00 2023-08-25T09:42:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0012870 con 0x7f03c006fb00 2023-08-25T09:42:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.616+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c01de4e0 con 0x7f03c006fb00 2023-08-25T09:42:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.617+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c01ddd80 con 0x7f03c006fb00 2023-08-25T09:42:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.617+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f03b00129d0 con 0x7f03c006fb00 2023-08-25T09:42:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.618+0000 7f03b77fe640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f03a006a050 0x7f03a006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.618+0000 7f03b7fff640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f03a006a050 0x7f03a006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.618+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03b0088030 con 0x7f03c006fb00 2023-08-25T09:42:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.618+0000 7f03b7fff640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f03a006a050 0x7f03a006c510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.622+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f03c01ddd80 con 0x7f03c006fb00 2023-08-25T09:42:19.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.788+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03c01ddd80 con 0x7f03c006fb00 2023-08-25T09:42:19.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.789+0000 7f03b77fe640 1 -- 172.21.15.89:0/805883025 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f03c01ddd80 con 0x7f03c006fb00 2023-08-25T09:42:19.791 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:19.791 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:19.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f03a006a050 msgr2=0x7f03a006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f03a006a050 0x7f03a006c510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a8008030 comp rx=0 tx=0).stop 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 msgr2=0x7f03c0142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0142270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c450 tx=0x7f03b000c910 comp rx=0 tx=0).stop 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 shutdown_connections 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f03a006a050 0x7f03a006c510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03c0141b90 0x7f03c0149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c00b7c10 0x7f03c01494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 --2- 172.21.15.89:0/805883025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03c006fb00 0x7f03c0142270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 >> 172.21.15.89:0/805883025 conn(0x7f03c0069a30 msgr2=0x7f03c006efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 shutdown_connections 2023-08-25T09:42:19.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.791+0000 7f03c51cf640 1 -- 172.21.15.89:0/805883025 wait complete. 2023-08-25T09:42:19.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:19.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.904+0000 7f2587d5d640 1 Processor -- start 2023-08-25T09:42:19.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.904+0000 7f2587d5d640 1 -- start start 2023-08-25T09:42:19.908 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f2587d5d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25801415c0 0x7f2580141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f2587d5d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f2580070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f2587d5d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258006e880 con 0x7f25800b7b80 2023-08-25T09:42:19.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f2587d5d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800b3570 con 0x7f25801415c0 2023-08-25T09:42:19.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f2587d5d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800711a0 con 0x7f2580070810 2023-08-25T09:42:19.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25801415c0 0x7f2580141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25801415c0 0x7f2580141a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36480/0 (socket says 172.21.15.89:36480) 2023-08-25T09:42:19.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 -- 172.21.15.89:0/1849240102 learned_addr learned my addr 172.21.15.89:0/1849240102 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:19.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25862fa640 1 --2- 172.21.15.89:0/1849240102 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f2580070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 -- 172.21.15.89:0/1849240102 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 msgr2=0x7f2580070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:19.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 --2- 172.21.15.89:0/1849240102 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f2580070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 -- 172.21.15.89:0/1849240102 >> v1:172.21.15.121:6789/0 conn(0x7f25800b7b80 legacy=0x7f25800b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.905+0000 7f25852f8640 1 -- 172.21.15.89:0/1849240102 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258014ab90 con 0x7f25801415c0 2023-08-25T09:42:19.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.906+0000 7f25852f8640 1 --2- 172.21.15.89:0/1849240102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25801415c0 0x7f2580141a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2570009870 tx=0x7f257002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb24fe4ca6e08c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.906+0000 7f2584af7640 1 -- 172.21.15.89:0/1849240102 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570030840 con 0x7f25801415c0 2023-08-25T09:42:19.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.906+0000 7f2584af7640 1 -- 172.21.15.89:0/1849240102 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700309a0 con 0x7f25801415c0 2023-08-25T09:42:19.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.906+0000 7f2584af7640 1 -- 172.21.15.89:0/1849240102 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570030d30 con 0x7f25801415c0 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 -- 172.21.15.89:0/1849240102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25801415c0 msgr2=0x7f2580141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 --2- 172.21.15.89:0/1849240102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25801415c0 0x7f2580141a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2570009870 tx=0x7f257002b980 comp rx=0 tx=0).stop 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 -- 172.21.15.89:0/1849240102 shutdown_connections 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 --2- 172.21.15.89:0/1849240102 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f2580070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 --2- 172.21.15.89:0/1849240102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25801415c0 0x7f2580141a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 -- 172.21.15.89:0/1849240102 >> 172.21.15.89:0/1849240102 conn(0x7f25800bbe80 msgr2=0x7f25800bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:19.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 -- 172.21.15.89:0/1849240102 shutdown_connections 2023-08-25T09:42:19.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.907+0000 7f2587d5d640 1 -- 172.21.15.89:0/1849240102 wait complete. 2023-08-25T09:42:19.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 Processor -- start 2023-08-25T09:42:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 -- start start 2023-08-25T09:42:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f258013ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 0x7f25801e1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25801415c0 0x7f25801ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258013bfb0 con 0x7f25800b7b80 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25801e0eb0 con 0x7f25801415c0 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f2587d5d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2580149520 con 0x7f2580070810 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f25852f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 0x7f25801e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f25852f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 0x7f25801e1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36486/0 (socket says 172.21.15.89:36486) 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.908+0000 7f25852f8640 1 -- 172.21.15.89:0/3241007241 learned_addr learned my addr 172.21.15.89:0/3241007241 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:19.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25862fa640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25801415c0 0x7f25801ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f2585af9640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f258013ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25852f8640 1 -- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 msgr2=0x7f258013ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25852f8640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f258013ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25852f8640 1 -- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25801415c0 msgr2=0x7f25801ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:19.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25852f8640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25801415c0 0x7f25801ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:19.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25852f8640 1 -- 172.21.15.89:0/3241007241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700094d0 con 0x7f25800b7b80 2023-08-25T09:42:19.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f2585af9640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f258013ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:19.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25852f8640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 0x7f25801e1690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2570000c00 tx=0x7f2570004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570039a90 con 0x7f25800b7b80 2023-08-25T09:42:19.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570039bf0 con 0x7f25800b7b80 2023-08-25T09:42:19.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570043410 con 0x7f25800b7b80 2023-08-25T09:42:19.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580149800 con 0x7f25800b7b80 2023-08-25T09:42:19.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.909+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580148780 con 0x7f25800b7b80 2023-08-25T09:42:19.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.910+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258006f280 con 0x7f25800b7b80 2023-08-25T09:42:19.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.910+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f257002f390 con 0x7f25800b7b80 2023-08-25T09:42:19.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.911+0000 7f25767fc640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f256406a050 0x7f256406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:19.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.911+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25700aa660 con 0x7f25800b7b80 2023-08-25T09:42:19.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.911+0000 7f2585af9640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f256406a050 0x7f256406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:19.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.911+0000 7f2585af9640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f256406a050 0x7f256406c510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f257c007fd0 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:19.934 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:19.915+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f258006f280 con 0x7f25800b7b80 2023-08-25T09:42:20.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.081+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f258006f280 con 0x7f25800b7b80 2023-08-25T09:42:20.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.081+0000 7f25767fc640 1 -- 172.21.15.89:0/3241007241 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f258006f280 con 0x7f25800b7b80 2023-08-25T09:42:20.083 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:20.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f256406a050 msgr2=0x7f256406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f256406a050 0x7f256406c510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f257c007fd0 tx=0x7f257c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:20.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 msgr2=0x7f25801e1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 0x7f25801e1690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2570000c00 tx=0x7f2570004730 comp rx=0 tx=0).stop 2023-08-25T09:42:20.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 shutdown_connections 2023-08-25T09:42:20.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f256406a050 0x7f256406c510 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25800b7b80 0x7f25801e1690 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25801415c0 0x7f25801ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 --2- 172.21.15.89:0/3241007241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2580070810 0x7f258013ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 >> 172.21.15.89:0/3241007241 conn(0x7f25800bbe80 msgr2=0x7f25800b8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 shutdown_connections 2023-08-25T09:42:20.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.083+0000 7f2587d5d640 1 -- 172.21.15.89:0/3241007241 wait complete. 2023-08-25T09:42:20.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:20.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.195+0000 7f9794071640 1 Processor -- start 2023-08-25T09:42:20.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.195+0000 7f9794071640 1 -- start start 2023-08-25T09:42:20.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f9794071640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f978c14a920 0x7f978c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f9794071640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f978c0bab10 0x7f978c155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f9794071640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c0b7fd0 con 0x7f978c0b7bf0 2023-08-25T09:42:20.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f9794071640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c14ad40 con 0x7f978c0bab10 2023-08-25T09:42:20.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f9794071640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c14eed0 con 0x7f978c14a920 2023-08-25T09:42:20.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f978c0bab10 0x7f978c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f978c0bab10 0x7f978c155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36496/0 (socket says 172.21.15.89:36496) 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 -- 172.21.15.89:0/3446072777 learned_addr learned my addr 172.21.15.89:0/3446072777 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979160c640 1 --2- 172.21.15.89:0/3446072777 >> v2:172.21.15.121:3300/0 conn(0x7f978c14a920 0x7f978c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 -- 172.21.15.89:0/3446072777 >> v2:172.21.15.121:3300/0 conn(0x7f978c14a920 msgr2=0x7f978c14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 --2- 172.21.15.89:0/3446072777 >> v2:172.21.15.121:3300/0 conn(0x7f978c14a920 0x7f978c14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 -- 172.21.15.89:0/3446072777 >> v1:172.21.15.121:6789/0 conn(0x7f978c0b7bf0 legacy=0x7f978c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.196+0000 7f979260e640 1 -- 172.21.15.89:0/3446072777 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0b5230 con 0x7f978c0bab10 2023-08-25T09:42:20.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.197+0000 7f979260e640 1 --2- 172.21.15.89:0/3446072777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0bab10 0x7f978c155280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f978c071a00 tx=0x7f978402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608285a8b0218772 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.197+0000 7f9790e0b640 1 -- 172.21.15.89:0/3446072777 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031750 con 0x7f978c0bab10 2023-08-25T09:42:20.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.197+0000 7f9790e0b640 1 -- 172.21.15.89:0/3446072777 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840318b0 con 0x7f978c0bab10 2023-08-25T09:42:20.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.197+0000 7f9790e0b640 1 -- 172.21.15.89:0/3446072777 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031c40 con 0x7f978c0bab10 2023-08-25T09:42:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 -- 172.21.15.89:0/3446072777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0bab10 msgr2=0x7f978c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 --2- 172.21.15.89:0/3446072777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0bab10 0x7f978c155280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f978c071a00 tx=0x7f978402b7f0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 -- 172.21.15.89:0/3446072777 shutdown_connections 2023-08-25T09:42:20.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 --2- 172.21.15.89:0/3446072777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0bab10 0x7f978c155280 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 --2- 172.21.15.89:0/3446072777 >> v2:172.21.15.121:3300/0 conn(0x7f978c14a920 0x7f978c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 -- 172.21.15.89:0/3446072777 >> 172.21.15.89:0/3446072777 conn(0x7f978c06e560 msgr2=0x7f978c06e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 -- 172.21.15.89:0/3446072777 shutdown_connections 2023-08-25T09:42:20.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.198+0000 7f9794071640 1 -- 172.21.15.89:0/3446072777 wait complete. 2023-08-25T09:42:20.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.199+0000 7f9794071640 1 Processor -- start 2023-08-25T09:42:20.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.199+0000 7f9794071640 1 -- start start 2023-08-25T09:42:20.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.199+0000 7f9794071640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 0x7f978c13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c0bab10 0x7f978c1e0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f978c14a920 0x7f978c1e3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c140100 con 0x7f978c0b7bf0 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c1dfb00 con 0x7f978c14a920 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c1dfde0 con 0x7f978c0bab10 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 0x7f978c13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 0x7f978c13fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36512/0 (socket says 172.21.15.89:36512) 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 -- 172.21.15.89:0/3663181744 learned_addr learned my addr 172.21.15.89:0/3663181744 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f979260e640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f978c14a920 0x7f978c1e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f979160c640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c0bab10 0x7f978c1e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 -- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c0bab10 msgr2=0x7f978c1e0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c0bab10 0x7f978c1e0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 -- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f978c14a920 msgr2=0x7f978c1e3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f978c14a920 0x7f978c1e3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 -- 172.21.15.89:0/3663181744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840094d0 con 0x7f978c0b7bf0 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f979260e640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f978c14a920 0x7f978c1e3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:20.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9791e0d640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 0x7f978c13fbc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f978800c7f0 tx=0x7f978800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800aa50 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800abb0 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0b6e60 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788012420 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.200+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c0b7100 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.201+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c04dc40 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.202+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9788012580 con 0x7f978c0b7bf0 2023-08-25T09:42:20.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.202+0000 7f97827fc640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f977006a050 0x7f977006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.202+0000 7f979160c640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f977006a050 0x7f977006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.202+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9788088480 con 0x7f978c0b7bf0 2023-08-25T09:42:20.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.202+0000 7f979160c640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f977006a050 0x7f977006c510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f977c006fd0 tx=0x7f977c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.206+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9788053c00 con 0x7f978c0b7bf0 2023-08-25T09:42:20.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.374+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f978c0b8fd0 con 0x7f978c0b7bf0 2023-08-25T09:42:20.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.375+0000 7f97827fc640 1 -- 172.21.15.89:0/3663181744 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9788057220 con 0x7f978c0b7bf0 2023-08-25T09:42:20.377 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:20.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f977006a050 msgr2=0x7f977006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f977006a050 0x7f977006c510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f977c006fd0 tx=0x7f977c008040 comp rx=0 tx=0).stop 2023-08-25T09:42:20.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 msgr2=0x7f978c13fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 0x7f978c13fbc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f978800c7f0 tx=0x7f978800ccb0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 shutdown_connections 2023-08-25T09:42:20.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f977006a050 0x7f977006c510 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f978c14a920 0x7f978c1e3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c0bab10 0x7f978c1e0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 --2- 172.21.15.89:0/3663181744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978c0b7bf0 0x7f978c13fbc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 >> 172.21.15.89:0/3663181744 conn(0x7f978c06e560 msgr2=0x7f978c071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 shutdown_connections 2023-08-25T09:42:20.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.377+0000 7f9794071640 1 -- 172.21.15.89:0/3663181744 wait complete. 2023-08-25T09:42:20.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:20.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.489+0000 7f15981c9640 1 Processor -- start 2023-08-25T09:42:20.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.489+0000 7f15981c9640 1 -- start start 2023-08-25T09:42:20.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f15981c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f159014a920 0x7f159014e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f15981c9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15900bab10 0x7f1590155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f15981c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15900b7fd0 con 0x7f15900b7bf0 2023-08-25T09:42:20.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f15981c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159014ad40 con 0x7f159014a920 2023-08-25T09:42:20.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f15981c9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159014eed0 con 0x7f15900bab10 2023-08-25T09:42:20.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f159014a920 0x7f159014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f159014a920 0x7f159014e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36526/0 (socket says 172.21.15.89:36526) 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595f65640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f15900b7bf0 0x7f159006a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37846/0 (socket says 172.21.15.89:37846) 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 -- 172.21.15.89:0/2681982499 learned_addr learned my addr 172.21.15.89:0/2681982499 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 -- 172.21.15.89:0/2681982499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15900bab10 msgr2=0x7f1590155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 --2- 172.21.15.89:0/2681982499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15900bab10 0x7f1590155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 -- 172.21.15.89:0/2681982499 >> v1:172.21.15.89:6789/0 conn(0x7f15900b7bf0 legacy=0x7f159006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1594f63640 1 -- 172.21.15.89:0/2681982499 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36971924 0 0) 0x7f158c001110 con 0x7f15900b7bf0 2023-08-25T09:42:20.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.490+0000 7f1595764640 1 -- 172.21.15.89:0/2681982499 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900b5230 con 0x7f159014a920 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f1595764640 1 --2- 172.21.15.89:0/2681982499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f159014a920 0x7f159014e990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1580009870 tx=0x7f158002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7048f2dc495ec4a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f1594f63640 1 -- 172.21.15.89:0/2681982499 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800317c0 con 0x7f159014a920 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f1594f63640 1 -- 172.21.15.89:0/2681982499 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580031920 con 0x7f159014a920 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f1594f63640 1 -- 172.21.15.89:0/2681982499 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580031cb0 con 0x7f159014a920 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f15981c9640 1 -- 172.21.15.89:0/2681982499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f159014a920 msgr2=0x7f159014e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f15981c9640 1 --2- 172.21.15.89:0/2681982499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f159014a920 0x7f159014e990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1580009870 tx=0x7f158002b860 comp rx=0 tx=0).stop 2023-08-25T09:42:20.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f15981c9640 1 -- 172.21.15.89:0/2681982499 shutdown_connections 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f15981c9640 1 --2- 172.21.15.89:0/2681982499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15900bab10 0x7f1590155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f15981c9640 1 --2- 172.21.15.89:0/2681982499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f159014a920 0x7f159014e990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.491+0000 7f15981c9640 1 -- 172.21.15.89:0/2681982499 >> 172.21.15.89:0/2681982499 conn(0x7f159006e560 msgr2=0x7f159006e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.492+0000 7f15981c9640 1 -- 172.21.15.89:0/2681982499 shutdown_connections 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.492+0000 7f15981c9640 1 -- 172.21.15.89:0/2681982499 wait complete. 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 Processor -- start 2023-08-25T09:42:20.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 -- start start 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15900b7bf0 0x7f159014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 0x7f15901478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f159014a920 0x7f1590147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590140410 con 0x7f15900bab10 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590147410 con 0x7f15900b7bf0 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f15981c9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159014a700 con 0x7f159014a920 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595764640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 0x7f15901478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595764640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 0x7f15901478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36532/0 (socket says 172.21.15.89:36532) 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595764640 1 -- 172.21.15.89:0/3746722136 learned_addr learned my addr 172.21.15.89:0/3746722136 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595f65640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15900b7bf0 0x7f159014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1596766640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f159014a920 0x7f1590147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595764640 1 -- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f159014a920 msgr2=0x7f1590147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595764640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f159014a920 0x7f1590147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.493+0000 7f1595764640 1 -- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15900b7bf0 msgr2=0x7f159014d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.499 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f1595764640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15900b7bf0 0x7f159014d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f1595764640 1 -- 172.21.15.89:0/3746722136 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15800094d0 con 0x7f15900bab10 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f1595764640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 0x7f15901478c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15800090b0 tx=0x7f15800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580032960 con 0x7f15900bab10 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580032b00 con 0x7f15900bab10 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1590145a20 con 0x7f15900bab10 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800453f0 con 0x7f15900bab10 2023-08-25T09:42:20.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.494+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15901460e0 con 0x7f15900bab10 2023-08-25T09:42:20.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.495+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15901475e0 con 0x7f15900bab10 2023-08-25T09:42:20.501 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.495+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f158004e450 con 0x7f15900bab10 2023-08-25T09:42:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.495+0000 7f15867fc640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f157406a050 0x7f157406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.496+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15800aa9d0 con 0x7f15900bab10 2023-08-25T09:42:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.496+0000 7f1595f65640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f157406a050 0x7f157406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.496+0000 7f1595f65640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f157406a050 0x7f157406c510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f158c000f60 tx=0x7f158c007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.502 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.500+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1580076150 con 0x7f15900bab10 2023-08-25T09:42:20.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.665+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f159004dc40 con 0x7f15900bab10 2023-08-25T09:42:20.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.665+0000 7f15867fc640 1 -- 172.21.15.89:0/3746722136 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1580079770 con 0x7f15900bab10 2023-08-25T09:42:20.667 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:20.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f157406a050 msgr2=0x7f157406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f157406a050 0x7f157406c510 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f158c000f60 tx=0x7f158c007c00 comp rx=0 tx=0).stop 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 msgr2=0x7f15901478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 0x7f15901478c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15800090b0 tx=0x7f15800046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 shutdown_connections 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f157406a050 0x7f157406c510 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15900bab10 0x7f15901478c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f159014a920 0x7f1590147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 --2- 172.21.15.89:0/3746722136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15900b7bf0 0x7f159014d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 >> 172.21.15.89:0/3746722136 conn(0x7f159006e560 msgr2=0x7f1590071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 shutdown_connections 2023-08-25T09:42:20.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.667+0000 7f15981c9640 1 -- 172.21.15.89:0/3746722136 wait complete. 2023-08-25T09:42:20.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:20.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.779+0000 7f35f755d640 1 Processor -- start 2023-08-25T09:42:20.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f755d640 1 -- start start 2023-08-25T09:42:20.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f755d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35f00bcf70 0x7f35f00bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f755d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35f014a9a0 0x7f35f014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f755d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00ba300 con 0x7f35f0144560 2023-08-25T09:42:20.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f755d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00b9640 con 0x7f35f00bcf70 2023-08-25T09:42:20.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f755d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00bcb40 con 0x7f35f014a9a0 2023-08-25T09:42:20.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f52f9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35f00bcf70 0x7f35f00bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f52f9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35f00bcf70 0x7f35f00bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36540/0 (socket says 172.21.15.89:36540) 2023-08-25T09:42:20.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f4af8640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f35f0144560 0x7f35f01449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37852/0 (socket says 172.21.15.89:37852) 2023-08-25T09:42:20.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.780+0000 7f35f52f9640 1 -- 172.21.15.89:0/637918093 learned_addr learned my addr 172.21.15.89:0/637918093 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:20.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35f5afa640 1 --2- 172.21.15.89:0/637918093 >> v2:172.21.15.121:3300/0 conn(0x7f35f014a9a0 0x7f35f014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35f52f9640 1 -- 172.21.15.89:0/637918093 >> v2:172.21.15.121:3300/0 conn(0x7f35f014a9a0 msgr2=0x7f35f014adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:20.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35f52f9640 1 --2- 172.21.15.89:0/637918093 >> v2:172.21.15.121:3300/0 conn(0x7f35f014a9a0 0x7f35f014adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35f52f9640 1 -- 172.21.15.89:0/637918093 >> v1:172.21.15.89:6789/0 conn(0x7f35f0144560 legacy=0x7f35f01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35f52f9640 1 -- 172.21.15.89:0/637918093 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00bc8c0 con 0x7f35f00bcf70 2023-08-25T09:42:20.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35e3fff640 1 -- 172.21.15.89:0/637918093 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740390570 0 0) 0x7f35f00ba300 con 0x7f35f0144560 2023-08-25T09:42:20.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.781+0000 7f35f52f9640 1 --2- 172.21.15.89:0/637918093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f00bcf70 0x7f35f00bc380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f35f00bd770 tx=0x7f35e802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdf5a9881ecdd93 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35e3fff640 1 -- 172.21.15.89:0/637918093 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8030860 con 0x7f35f00bcf70 2023-08-25T09:42:20.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35e3fff640 1 -- 172.21.15.89:0/637918093 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80309c0 con 0x7f35f00bcf70 2023-08-25T09:42:20.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35e3fff640 1 -- 172.21.15.89:0/637918093 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8030d50 con 0x7f35f00bcf70 2023-08-25T09:42:20.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 -- 172.21.15.89:0/637918093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f00bcf70 msgr2=0x7f35f00bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 --2- 172.21.15.89:0/637918093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f00bcf70 0x7f35f00bc380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f35f00bd770 tx=0x7f35e802b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 -- 172.21.15.89:0/637918093 shutdown_connections 2023-08-25T09:42:20.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 --2- 172.21.15.89:0/637918093 >> v2:172.21.15.121:3300/0 conn(0x7f35f014a9a0 0x7f35f014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 --2- 172.21.15.89:0/637918093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f00bcf70 0x7f35f00bc380 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 -- 172.21.15.89:0/637918093 >> 172.21.15.89:0/637918093 conn(0x7f35f00654f0 msgr2=0x7f35f00658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 -- 172.21.15.89:0/637918093 shutdown_connections 2023-08-25T09:42:20.789 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.782+0000 7f35f755d640 1 -- 172.21.15.89:0/637918093 wait complete. 2023-08-25T09:42:20.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.783+0000 7f35f755d640 1 Processor -- start 2023-08-25T09:42:20.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.783+0000 7f35f755d640 1 -- start start 2023-08-25T09:42:20.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f755d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35f00bcf70 0x7f35f01dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f755d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 0x7f35f01450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f755d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35f014a9a0 0x7f35f0145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f755d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01e00e0 con 0x7f35f0144560 2023-08-25T09:42:20.792 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f755d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01e0890 con 0x7f35f014a9a0 2023-08-25T09:42:20.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f755d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01e0310 con 0x7f35f00bcf70 2023-08-25T09:42:20.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 0x7f35f01450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 0x7f35f01450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36554/0 (socket says 172.21.15.89:36554) 2023-08-25T09:42:20.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 -- 172.21.15.89:0/1324635908 learned_addr learned my addr 172.21.15.89:0/1324635908 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:20.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f5afa640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35f014a9a0 0x7f35f0145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f52f9640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35f00bcf70 0x7f35f01dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 -- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35f00bcf70 msgr2=0x7f35f01dfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35f00bcf70 0x7f35f01dfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 -- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35f014a9a0 msgr2=0x7f35f0145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35f014a9a0 0x7f35f0145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 -- 172.21.15.89:0/1324635908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80094d0 con 0x7f35f0144560 2023-08-25T09:42:20.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f5afa640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35f014a9a0 0x7f35f0145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:20.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35f4af8640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 0x7f35f01450f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c890 tx=0x7f35e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.784+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400a640 con 0x7f35f0144560 2023-08-25T09:42:20.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.785+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e400a7c0 con 0x7f35f0144560 2023-08-25T09:42:20.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.785+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f01e05b0 con 0x7f35f0144560 2023-08-25T09:42:20.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.785+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e400ab70 con 0x7f35f0144560 2023-08-25T09:42:20.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.785+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f0065ab0 con 0x7f35f0144560 2023-08-25T09:42:20.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.786+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f0145c40 con 0x7f35f0144560 2023-08-25T09:42:20.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.786+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f35e400acd0 con 0x7f35f0144560 2023-08-25T09:42:20.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.786+0000 7f35e1ffb640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35d406a080 0x7f35d406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:20.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.787+0000 7f35f52f9640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35d406a080 0x7f35d406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:20.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.787+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35e4087dc0 con 0x7f35f0144560 2023-08-25T09:42:20.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.787+0000 7f35f52f9640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35d406a080 0x7f35d406c540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f35e8036000 tx=0x7f35e803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:20.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.791+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f35f0145c40 con 0x7f35f0144560 2023-08-25T09:42:20.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.957+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35f0145c40 con 0x7f35f0144560 2023-08-25T09:42:20.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.958+0000 7f35e1ffb640 1 -- 172.21.15.89:0/1324635908 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35f0145c40 con 0x7f35f0144560 2023-08-25T09:42:20.960 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:20.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.959+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35d406a080 msgr2=0x7f35d406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.959+0000 7f35f755d640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35d406a080 0x7f35d406c540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f35e8036000 tx=0x7f35e803b040 comp rx=0 tx=0).stop 2023-08-25T09:42:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.959+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 msgr2=0x7f35f01450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.959+0000 7f35f755d640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 0x7f35f01450f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c890 tx=0x7f35e400cd50 comp rx=0 tx=0).stop 2023-08-25T09:42:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 shutdown_connections 2023-08-25T09:42:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f35d406a080 0x7f35d406c540 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35f0144560 0x7f35f01450f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35f014a9a0 0x7f35f0145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 --2- 172.21.15.89:0/1324635908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35f00bcf70 0x7f35f01dfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 >> 172.21.15.89:0/1324635908 conn(0x7f35f00654f0 msgr2=0x7f35f00b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 shutdown_connections 2023-08-25T09:42:20.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:20.960+0000 7f35f755d640 1 -- 172.21.15.89:0/1324635908 wait complete. 2023-08-25T09:42:20.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:21.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.070+0000 7fa08f034640 1 Processor -- start 2023-08-25T09:42:21.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.070+0000 7fa08f034640 1 -- start start 2023-08-25T09:42:21.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08f034640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0880b6900 0x7fa088070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08f034640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880705f0 0x7fa088071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08f034640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880b9150 con 0x7fa0880b3eb0 2023-08-25T09:42:21.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08f034640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880b9430 con 0x7fa0880b6900 2023-08-25T09:42:21.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08f034640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa088070210 con 0x7fa0880705f0 2023-08-25T09:42:21.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa087fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880705f0 0x7fa088071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08cdd0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0880b6900 0x7fa088070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08d5d1640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa0880b3eb0 0x7fa0880b7980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:47280/0 (socket says 172.21.15.89:47280) 2023-08-25T09:42:21.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08d5d1640 1 -- 172.21.15.89:0/3264050591 learned_addr learned my addr 172.21.15.89:0/3264050591 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:21.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.071+0000 7fa08cdd0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0880b6900 0x7fa088070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:45688/0 (socket says 172.21.15.89:45688) 2023-08-25T09:42:21.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.072+0000 7fa08cdd0640 1 -- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880705f0 msgr2=0x7fa088071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:21.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.072+0000 7fa08cdd0640 1 --2- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880705f0 0x7fa088071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.072+0000 7fa08cdd0640 1 -- 172.21.15.89:0/3264050591 >> v1:172.21.15.121:6789/0 conn(0x7fa0880b3eb0 legacy=0x7fa0880b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.072+0000 7fa08cdd0640 1 -- 172.21.15.89:0/3264050591 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08806fa60 con 0x7fa0880b6900 2023-08-25T09:42:21.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.072+0000 7fa0877fe640 1 -- 172.21.15.89:0/3264050591 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536706567 0 0) 0x7fa0880b9150 con 0x7fa0880b3eb0 2023-08-25T09:42:21.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08cdd0640 1 --2- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b6900 0x7fa088070b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0780097a0 tx=0x7fa07802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7647017c064aa369 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa0877fe640 1 -- 172.21.15.89:0/3264050591 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078030610 con 0x7fa0880b6900 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa0877fe640 1 -- 172.21.15.89:0/3264050591 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa078030770 con 0x7fa0880b6900 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa0877fe640 1 -- 172.21.15.89:0/3264050591 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078030b00 con 0x7fa0880b6900 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 -- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b6900 msgr2=0x7fa088070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 --2- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b6900 0x7fa088070b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0780097a0 tx=0x7fa07802b960 comp rx=0 tx=0).stop 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 -- 172.21.15.89:0/3264050591 shutdown_connections 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 --2- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880705f0 0x7fa088071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 --2- 172.21.15.89:0/3264050591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b6900 0x7fa088070b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 -- 172.21.15.89:0/3264050591 >> 172.21.15.89:0/3264050591 conn(0x7fa0880bcfc0 msgr2=0x7fa0880bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 -- 172.21.15.89:0/3264050591 shutdown_connections 2023-08-25T09:42:21.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.073+0000 7fa08f034640 1 -- 172.21.15.89:0/3264050591 wait complete. 2023-08-25T09:42:21.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.074+0000 7fa08f034640 1 Processor -- start 2023-08-25T09:42:21.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.074+0000 7fa08f034640 1 -- start start 2023-08-25T09:42:21.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08f034640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 0x7fa08813e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08f034640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b3eb0 0x7fa08813a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08f034640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880b6900 0x7fa08813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08f034640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08813edc0 con 0x7fa0880705f0 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08f034640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08813b890 con 0x7fa0880b3eb0 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08f034640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08813f5a0 con 0x7fa0880b6900 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 0x7fa08813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 0x7fa08813e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36556/0 (socket says 172.21.15.89:36556) 2023-08-25T09:42:21.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 -- 172.21.15.89:0/1970080897 learned_addr learned my addr 172.21.15.89:0/1970080897 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa087fff640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b3eb0 0x7fa08813a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08d5d1640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880b6900 0x7fa08813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 -- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880b6900 msgr2=0x7fa08813ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880b6900 0x7fa08813ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 -- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b3eb0 msgr2=0x7fa08813a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.075+0000 7fa08cdd0640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b3eb0 0x7fa08813a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa08cdd0640 1 -- 172.21.15.89:0/1970080897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078009400 con 0x7fa0880705f0 2023-08-25T09:42:21.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa08d5d1640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880b6900 0x7fa08813ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa08cdd0640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 0x7fa08813e880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa07802bf70 tx=0x7fa0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07803e070 con 0x7fa0880705f0 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa078030e10 con 0x7fa0880705f0 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078039c30 con 0x7fa0880705f0 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08813bb20 con 0x7fa0880705f0 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.076+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08813f960 con 0x7fa0880705f0 2023-08-25T09:42:21.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.077+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08813a670 con 0x7fa0880705f0 2023-08-25T09:42:21.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.078+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0780423f0 con 0x7fa0880705f0 2023-08-25T09:42:21.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.078+0000 7fa0857fa640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa07406a050 0x7fa07406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.078+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0780a9ef0 con 0x7fa0880705f0 2023-08-25T09:42:21.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.078+0000 7fa087fff640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa07406a050 0x7fa07406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.078+0000 7fa087fff640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa07406a050 0x7fa07406c510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa0881d2140 tx=0x7fa07c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.082+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa078075610 con 0x7fa0880705f0 2023-08-25T09:42:21.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.247+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa088066c50 con 0x7fa0880705f0 2023-08-25T09:42:21.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.248+0000 7fa0857fa640 1 -- 172.21.15.89:0/1970080897 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fa078078c30 con 0x7fa0880705f0 2023-08-25T09:42:21.250 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:21.250 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:21.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa07406a050 msgr2=0x7fa07406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa07406a050 0x7fa07406c510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa0881d2140 tx=0x7fa07c009190 comp rx=0 tx=0).stop 2023-08-25T09:42:21.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 msgr2=0x7fa08813e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 0x7fa08813e880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa07802bf70 tx=0x7fa0780046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 shutdown_connections 2023-08-25T09:42:21.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa07406a050 0x7fa07406c510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0880b6900 0x7fa08813ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0880b3eb0 0x7fa08813a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 --2- 172.21.15.89:0/1970080897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0880705f0 0x7fa08813e880 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 >> 172.21.15.89:0/1970080897 conn(0x7fa0880bcfc0 msgr2=0x7fa08806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 shutdown_connections 2023-08-25T09:42:21.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.250+0000 7fa08f034640 1 -- 172.21.15.89:0/1970080897 wait complete. 2023-08-25T09:42:21.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:21.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.364+0000 7fb40c522640 1 Processor -- start 2023-08-25T09:42:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.364+0000 7fb40c522640 1 -- start start 2023-08-25T09:42:21.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb40c522640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb404070620 0x7fb404148940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb40c522640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb404148e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb40c522640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040b4160 con 0x7fb4040b6900 2023-08-25T09:42:21.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb40c522640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb404070060 con 0x7fb404070620 2023-08-25T09:42:21.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb40c522640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404069ca0 con 0x7fb404142c80 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb409abd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb404070620 0x7fb404148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb409abd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb404070620 0x7fb404148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36568/0 (socket says 172.21.15.89:36568) 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb409abd640 1 -- 172.21.15.89:0/1947172289 learned_addr learned my addr 172.21.15.89:0/1947172289 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb40aabf640 1 --2- 172.21.15.89:0/1947172289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb404148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.365+0000 7fb409abd640 1 -- 172.21.15.89:0/1947172289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 msgr2=0x7fb404148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb409abd640 1 --2- 172.21.15.89:0/1947172289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb404148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb409abd640 1 -- 172.21.15.89:0/1947172289 >> v1:172.21.15.121:6789/0 conn(0x7fb4040b6900 legacy=0x7fb404142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb409abd640 1 -- 172.21.15.89:0/1947172289 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040712c0 con 0x7fb404070620 2023-08-25T09:42:21.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb409abd640 1 --2- 172.21.15.89:0/1947172289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb404148940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009870 tx=0x7fb3f402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcae1aa0e20f201 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb4092bc640 1 -- 172.21.15.89:0/1947172289 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f402f840 con 0x7fb404070620 2023-08-25T09:42:21.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb4092bc640 1 -- 172.21.15.89:0/1947172289 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f402f9a0 con 0x7fb404070620 2023-08-25T09:42:21.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.366+0000 7fb4092bc640 1 -- 172.21.15.89:0/1947172289 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f402fd30 con 0x7fb404070620 2023-08-25T09:42:21.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 -- 172.21.15.89:0/1947172289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 msgr2=0x7fb404148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 --2- 172.21.15.89:0/1947172289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb404148940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009870 tx=0x7fb3f402ba20 comp rx=0 tx=0).stop 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 -- 172.21.15.89:0/1947172289 shutdown_connections 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 --2- 172.21.15.89:0/1947172289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb404148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 --2- 172.21.15.89:0/1947172289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb404148940 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 -- 172.21.15.89:0/1947172289 >> 172.21.15.89:0/1947172289 conn(0x7fb4040b9a80 msgr2=0x7fb4040b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 -- 172.21.15.89:0/1947172289 shutdown_connections 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.367+0000 7fb40c522640 1 -- 172.21.15.89:0/1947172289 wait complete. 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.368+0000 7fb40c522640 1 Processor -- start 2023-08-25T09:42:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.368+0000 7fb40c522640 1 -- start start 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40c522640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb4041e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40c522640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4040b6900 0x7fb40413a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40c522640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb4040bc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40c522640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040bce60 con 0x7fb404070620 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40c522640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041e1760 con 0x7fb4040b6900 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40c522640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040bbb70 con 0x7fb404142c80 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb4041e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb4041e0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36576/0 (socket says 172.21.15.89:36576) 2023-08-25T09:42:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 -- 172.21.15.89:0/3106741650 learned_addr learned my addr 172.21.15.89:0/3106741650 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb409abd640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4040b6900 0x7fb40413a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40aabf640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb4040bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 -- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 msgr2=0x7fb4040bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb4040bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 -- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4040b6900 msgr2=0x7fb40413a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4040b6900 0x7fb40413a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 -- 172.21.15.89:0/3106741650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40094d0 con 0x7fb404070620 2023-08-25T09:42:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.369+0000 7fb40a2be640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb4041e0ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c450 tx=0x7fb40000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.370+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000052d0 con 0x7fb404070620 2023-08-25T09:42:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.370+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400005430 con 0x7fb404070620 2023-08-25T09:42:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.370+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400012870 con 0x7fb404070620 2023-08-25T09:42:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.370+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040bdb30 con 0x7fb404070620 2023-08-25T09:42:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.370+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040bb800 con 0x7fb404070620 2023-08-25T09:42:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.371+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40404dc40 con 0x7fb404070620 2023-08-25T09:42:21.379 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.372+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb4000129d0 con 0x7fb404070620 2023-08-25T09:42:21.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.372+0000 7fb3faffd640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb3e806a050 0x7fb3e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.372+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb400087f20 con 0x7fb404070620 2023-08-25T09:42:21.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.372+0000 7fb409abd640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb3e806a050 0x7fb3e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.372+0000 7fb409abd640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb3e806a050 0x7fb3e806c510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4036000 tx=0x7fb3f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.380 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.376+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb400053610 con 0x7fb404070620 2023-08-25T09:42:21.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.542+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4040b4160 con 0x7fb404070620 2023-08-25T09:42:21.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.542+0000 7fb3faffd640 1 -- 172.21.15.89:0/3106741650 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb400056c30 con 0x7fb404070620 2023-08-25T09:42:21.544 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb3e806a050 msgr2=0x7fb3e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb3e806a050 0x7fb3e806c510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4036000 tx=0x7fb3f4008030 comp rx=0 tx=0).stop 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 msgr2=0x7fb4041e0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb4041e0ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c450 tx=0x7fb40000c910 comp rx=0 tx=0).stop 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 shutdown_connections 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb3e806a050 0x7fb3e806c510 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb404142c80 0x7fb4040bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4040b6900 0x7fb40413a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 --2- 172.21.15.89:0/3106741650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb404070620 0x7fb4041e0ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 >> 172.21.15.89:0/3106741650 conn(0x7fb4040b9a80 msgr2=0x7fb4041477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 shutdown_connections 2023-08-25T09:42:21.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.544+0000 7fb40c522640 1 -- 172.21.15.89:0/3106741650 wait complete. 2023-08-25T09:42:21.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:21.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.656+0000 7fbb2d81f640 1 Processor -- start 2023-08-25T09:42:21.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.656+0000 7fbb2d81f640 1 -- start start 2023-08-25T09:42:21.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb2d81f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbb2814e990 0x7fbb28156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb2d81f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280b7fd0 con 0x7fbb2814a920 2023-08-25T09:42:21.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb2d81f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280b5230 con 0x7fbb280b7bf0 2023-08-25T09:42:21.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb2d81f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2814ad40 con 0x7fbb2814e990 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb277fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbb2814e990 0x7fbb28156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb267fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbb2814a920 0x7fbb280bab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37862/0 (socket says 172.21.15.89:37862) 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb267fc640 1 -- 172.21.15.89:0/787249812 learned_addr learned my addr 172.21.15.89:0/787249812 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb277fe640 1 -- 172.21.15.89:0/787249812 >> v1:172.21.15.121:6789/0 conn(0x7fbb280b7bf0 legacy=0x7fbb2806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb277fe640 1 -- 172.21.15.89:0/787249812 >> v1:172.21.15.89:6789/0 conn(0x7fbb2814a920 legacy=0x7fbb280bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb277fe640 1 -- 172.21.15.89:0/787249812 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280bb220 con 0x7fbb2814e990 2023-08-25T09:42:21.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.657+0000 7fbb25ffb640 1 -- 172.21.15.89:0/787249812 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671294025 0 0) 0x7fbb1c001110 con 0x7fbb2814a920 2023-08-25T09:42:21.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb277fe640 1 --2- 172.21.15.89:0/787249812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb2814e990 0x7fbb28156290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009d90 tx=0x7fbb2002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e4891b9c3c715f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb25ffb640 1 -- 172.21.15.89:0/787249812 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2002cbd0 con 0x7fbb2814e990 2023-08-25T09:42:21.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb25ffb640 1 -- 172.21.15.89:0/787249812 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2002cd30 con 0x7fbb2814e990 2023-08-25T09:42:21.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb25ffb640 1 -- 172.21.15.89:0/787249812 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2002cea0 con 0x7fbb2814e990 2023-08-25T09:42:21.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb2d81f640 1 -- 172.21.15.89:0/787249812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb2814e990 msgr2=0x7fbb28156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/787249812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb2814e990 0x7fbb28156290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009d90 tx=0x7fbb2002be20 comp rx=0 tx=0).stop 2023-08-25T09:42:21.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb2d81f640 1 -- 172.21.15.89:0/787249812 shutdown_connections 2023-08-25T09:42:21.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.658+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/787249812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb2814e990 0x7fbb28156290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.659+0000 7fbb2d81f640 1 -- 172.21.15.89:0/787249812 >> 172.21.15.89:0/787249812 conn(0x7fbb2806e560 msgr2=0x7fbb2806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.659+0000 7fbb2d81f640 1 -- 172.21.15.89:0/787249812 shutdown_connections 2023-08-25T09:42:21.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.659+0000 7fbb2d81f640 1 -- 172.21.15.89:0/787249812 wait complete. 2023-08-25T09:42:21.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.659+0000 7fbb2d81f640 1 Processor -- start 2023-08-25T09:42:21.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 -- start start 2023-08-25T09:42:21.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 0x7fbb281d7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb2814a920 0x7fbb281d5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb2814e990 0x7fbb280b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb281d78a0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb281d6360 con 0x7fbb2814a920 2023-08-25T09:42:21.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb2d81f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280b5460 con 0x7fbb2814e990 2023-08-25T09:42:21.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb26ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 0x7fbb281d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb26ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 0x7fbb281d7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36596/0 (socket says 172.21.15.89:36596) 2023-08-25T09:42:21.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.660+0000 7fbb26ffd640 1 -- 172.21.15.89:0/570725616 learned_addr learned my addr 172.21.15.89:0/570725616 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb26ffd640 1 -- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb2814e990 msgr2=0x7fbb280b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb26ffd640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb2814e990 0x7fbb280b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb26ffd640 1 -- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb2814a920 msgr2=0x7fbb281d5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb267fc640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb2814a920 0x7fbb281d5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb26ffd640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb2814a920 0x7fbb281d5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb26ffd640 1 -- 172.21.15.89:0/570725616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009a70 con 0x7fbb280b7bf0 2023-08-25T09:42:21.672 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb26ffd640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 0x7fbb281d7360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c400 tx=0x7fbb1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180052d0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18005430 con 0x7fbb280b7bf0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280b56d0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003830 con 0x7fbb280b7bf0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.661+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb281d65c0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.662+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb280b5bf0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.662+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb18003990 con 0x7fbb280b7bf0 2023-08-25T09:42:21.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.663+0000 7fbb0ffff640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb1406a050 0x7fbb1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.663+0000 7fbb267fc640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb1406a050 0x7fbb1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.663+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb18087a90 con 0x7fbb280b7bf0 2023-08-25T09:42:21.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.663+0000 7fbb267fc640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb1406a050 0x7fbb1406c510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb28142a50 tx=0x7fbb1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.667+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbb280b5bf0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.832+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb280b5bf0 con 0x7fbb280b7bf0 2023-08-25T09:42:21.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.832+0000 7fbb0ffff640 1 -- 172.21.15.89:0/570725616 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb18017020 con 0x7fbb280b7bf0 2023-08-25T09:42:21.835 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb1406a050 msgr2=0x7fbb1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb1406a050 0x7fbb1406c510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb28142a50 tx=0x7fbb1c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 msgr2=0x7fbb281d7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 0x7fbb281d7360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c400 tx=0x7fbb1800c8c0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 shutdown_connections 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb1406a050 0x7fbb1406c510 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb2814e990 0x7fbb280b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb2814a920 0x7fbb281d5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 --2- 172.21.15.89:0/570725616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb280b7bf0 0x7fbb281d7360 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 >> 172.21.15.89:0/570725616 conn(0x7fbb2806e560 msgr2=0x7fbb28142ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 shutdown_connections 2023-08-25T09:42:21.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.834+0000 7fbb2d81f640 1 -- 172.21.15.89:0/570725616 wait complete. 2023-08-25T09:42:21.846 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:21.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.946+0000 7f4622fd6640 1 Processor -- start 2023-08-25T09:42:21.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.946+0000 7f4622fd6640 1 -- start start 2023-08-25T09:42:21.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f4622fd6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f461c0b8d10 0x7f461c071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f4622fd6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0b8580 con 0x7f461c0b3b40 2023-08-25T09:42:21.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f4622fd6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0b40f0 con 0x7f461c06aad0 2023-08-25T09:42:21.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f4622fd6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0b4930 con 0x7f461c0b8d10 2023-08-25T09:42:21.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f461bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f461c0b8d10 0x7f461c071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f4621573640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f461c0b3b40 0x7f461c142090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37872/0 (socket says 172.21.15.89:37872) 2023-08-25T09:42:21.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f461bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f461c0b8d10 0x7f461c071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36610/0 (socket says 172.21.15.89:36610) 2023-08-25T09:42:21.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f4621573640 1 -- 172.21.15.89:0/620581244 learned_addr learned my addr 172.21.15.89:0/620581244 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:21.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f461bfff640 1 -- 172.21.15.89:0/620581244 >> v1:172.21.15.121:6789/0 conn(0x7f461c06aad0 legacy=0x7f461c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f461bfff640 1 -- 172.21.15.89:0/620581244 >> v1:172.21.15.89:6789/0 conn(0x7f461c0b3b40 legacy=0x7f461c142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f461bfff640 1 -- 172.21.15.89:0/620581244 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0b87f0 con 0x7f461c0b8d10 2023-08-25T09:42:21.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.947+0000 7f461b7fe640 1 -- 172.21.15.89:0/620581244 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095340433 0 0) 0x7f461c0b8580 con 0x7f461c0b3b40 2023-08-25T09:42:21.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f461bfff640 1 --2- 172.21.15.89:0/620581244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b8d10 0x7f461c071a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46080097a0 tx=0x7f460802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d24d918e7e42b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f461b7fe640 1 -- 172.21.15.89:0/620581244 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608031830 con 0x7f461c0b8d10 2023-08-25T09:42:21.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f461b7fe640 1 -- 172.21.15.89:0/620581244 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4608031990 con 0x7f461c0b8d10 2023-08-25T09:42:21.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f461b7fe640 1 -- 172.21.15.89:0/620581244 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608031d20 con 0x7f461c0b8d10 2023-08-25T09:42:21.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f4622fd6640 1 -- 172.21.15.89:0/620581244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b8d10 msgr2=0x7f461c071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f4622fd6640 1 --2- 172.21.15.89:0/620581244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b8d10 0x7f461c071a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f46080097a0 tx=0x7f460802b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f4622fd6640 1 -- 172.21.15.89:0/620581244 shutdown_connections 2023-08-25T09:42:21.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f4622fd6640 1 --2- 172.21.15.89:0/620581244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b8d10 0x7f461c071a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.948+0000 7f4622fd6640 1 -- 172.21.15.89:0/620581244 >> 172.21.15.89:0/620581244 conn(0x7f461c0b91c0 msgr2=0x7f461c0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:21.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.949+0000 7f4622fd6640 1 -- 172.21.15.89:0/620581244 shutdown_connections 2023-08-25T09:42:21.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.949+0000 7f4622fd6640 1 -- 172.21.15.89:0/620581244 wait complete. 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.949+0000 7f4622fd6640 1 Processor -- start 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 -- start start 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f461c06aad0 0x7f461c148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 0x7f461c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f461c0b8d10 0x7f461c0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c148290 con 0x7f461c0b3b40 2023-08-25T09:42:21.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c13c590 con 0x7f461c06aad0 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4622fd6640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c147710 con 0x7f461c0b8d10 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f461bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 0x7f461c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f461bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 0x7f461c147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36616/0 (socket says 172.21.15.89:36616) 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f461bfff640 1 -- 172.21.15.89:0/2191220656 learned_addr learned my addr 172.21.15.89:0/2191220656 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4620d72640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f461c06aad0 0x7f461c148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.950+0000 7f4621573640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f461c0b8d10 0x7f461c0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f461bfff640 1 -- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f461c0b8d10 msgr2=0x7f461c0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f461bfff640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f461c0b8d10 0x7f461c0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f461bfff640 1 -- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f461c06aad0 msgr2=0x7f461c148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f461bfff640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f461c06aad0 0x7f461c148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f461bfff640 1 -- 172.21.15.89:0/2191220656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608009400 con 0x7f461c0b3b40 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f461bfff640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 0x7f461c147d50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4608000c00 tx=0x7f46080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460803aa60 con 0x7f461c0b3b40 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460803abc0 con 0x7f461c0b3b40 2023-08-25T09:42:21.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c147210 con 0x7f461c0b3b40 2023-08-25T09:42:21.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080443f0 con 0x7f461c0b3b40 2023-08-25T09:42:21.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.951+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c146f30 con 0x7f461c0b3b40 2023-08-25T09:42:21.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.952+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c1478a0 con 0x7f461c0b3b40 2023-08-25T09:42:21.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.952+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f460804d450 con 0x7f461c0b3b40 2023-08-25T09:42:21.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.953+0000 7f46197fa640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f460006a080 0x7f460006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:21.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.953+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46080aa590 con 0x7f461c0b3b40 2023-08-25T09:42:21.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.953+0000 7f4620d72640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f460006a080 0x7f460006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:21.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.953+0000 7f4620d72640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f460006a080 0x7f460006c540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4610000f60 tx=0x7f4610009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:21.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:21.957+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4608075dc0 con 0x7f461c0b3b40 2023-08-25T09:42:22.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.123+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f461c04dc40 con 0x7f461c0b3b40 2023-08-25T09:42:22.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.123+0000 7f46197fa640 1 -- 172.21.15.89:0/2191220656 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46080793e0 con 0x7f461c0b3b40 2023-08-25T09:42:22.126 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:22.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f460006a080 msgr2=0x7f460006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f460006a080 0x7f460006c540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4610000f60 tx=0x7f4610009040 comp rx=0 tx=0).stop 2023-08-25T09:42:22.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 msgr2=0x7f461c147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 0x7f461c147d50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4608000c00 tx=0x7f46080046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 shutdown_connections 2023-08-25T09:42:22.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f460006a080 0x7f460006c540 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f461c0b3b40 0x7f461c147d50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f461c0b8d10 0x7f461c0b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 --2- 172.21.15.89:0/2191220656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f461c06aad0 0x7f461c148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 >> 172.21.15.89:0/2191220656 conn(0x7f461c0b91c0 msgr2=0x7f461c0b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:22.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 shutdown_connections 2023-08-25T09:42:22.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.125+0000 7f4622fd6640 1 -- 172.21.15.89:0/2191220656 wait complete. 2023-08-25T09:42:22.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:22.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.239+0000 7fb1fc083640 1 Processor -- start 2023-08-25T09:42:22.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1fc083640 1 -- start start 2023-08-25T09:42:22.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1fc083640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1f4071bd0 0x7fb1f4070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1fc083640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1fc083640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f406fb80 con 0x7fb1f406aad0 2023-08-25T09:42:22.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1fc083640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f4070e30 con 0x7fb1f4071bd0 2023-08-25T09:42:22.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1fc083640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40b8860 con 0x7fb1f41447b0 2023-08-25T09:42:22.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1f961e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1f4071bd0 0x7fb1f4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1f9e1f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb1f406aad0 0x7fb1f406ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37882/0 (socket says 172.21.15.89:37882) 2023-08-25T09:42:22.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1f961e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1f4071bd0 0x7fb1f4070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36618/0 (socket says 172.21.15.89:36618) 2023-08-25T09:42:22.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.240+0000 7fb1f9e1f640 1 -- 172.21.15.89:0/3655951828 learned_addr learned my addr 172.21.15.89:0/3655951828 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:22.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1fa620640 1 --2- 172.21.15.89:0/3655951828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1f961e640 1 -- 172.21.15.89:0/3655951828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 msgr2=0x7fb1f41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:22.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1f961e640 1 --2- 172.21.15.89:0/3655951828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1f961e640 1 -- 172.21.15.89:0/3655951828 >> v1:172.21.15.89:6789/0 conn(0x7fb1f406aad0 legacy=0x7fb1f406ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1f961e640 1 -- 172.21.15.89:0/3655951828 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40b8b40 con 0x7fb1f4071bd0 2023-08-25T09:42:22.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1f8e1d640 1 -- 172.21.15.89:0/3655951828 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812149696 0 0) 0x7fb1f406fb80 con 0x7fb1f406aad0 2023-08-25T09:42:22.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.241+0000 7fb1f961e640 1 --2- 172.21.15.89:0/3655951828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f4070010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2445b6c228af532 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1f8e1d640 1 -- 172.21.15.89:0/3655951828 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4030610 con 0x7fb1f4071bd0 2023-08-25T09:42:22.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1f8e1d640 1 -- 172.21.15.89:0/3655951828 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4030770 con 0x7fb1f4071bd0 2023-08-25T09:42:22.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1f8e1d640 1 -- 172.21.15.89:0/3655951828 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4030b00 con 0x7fb1f4071bd0 2023-08-25T09:42:22.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 -- 172.21.15.89:0/3655951828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 msgr2=0x7fb1f4070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 --2- 172.21.15.89:0/3655951828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f4070010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e402b960 comp rx=0 tx=0).stop 2023-08-25T09:42:22.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 -- 172.21.15.89:0/3655951828 shutdown_connections 2023-08-25T09:42:22.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 --2- 172.21.15.89:0/3655951828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 --2- 172.21.15.89:0/3655951828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f4070010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 -- 172.21.15.89:0/3655951828 >> 172.21.15.89:0/3655951828 conn(0x7fb1f40b91c0 msgr2=0x7fb1f40b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:22.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 -- 172.21.15.89:0/3655951828 shutdown_connections 2023-08-25T09:42:22.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.242+0000 7fb1fc083640 1 -- 172.21.15.89:0/3655951828 wait complete. 2023-08-25T09:42:22.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.243+0000 7fb1fc083640 1 Processor -- start 2023-08-25T09:42:22.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.243+0000 7fb1fc083640 1 -- start start 2023-08-25T09:42:22.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fc083640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1f406aad0 0x7fb1f413edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fc083640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fc083640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41e0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fc083640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f413f330 con 0x7fb1f4071bd0 2023-08-25T09:42:22.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fc083640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f414c060 con 0x7fb1f406aad0 2023-08-25T09:42:22.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fc083640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f414e500 con 0x7fb1f41447b0 2023-08-25T09:42:22.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f414c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36632/0 (socket says 172.21.15.89:36632) 2023-08-25T09:42:22.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 -- 172.21.15.89:0/1414428796 learned_addr learned my addr 172.21.15.89:0/1414428796 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:22.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f9e1f640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1f406aad0 0x7fb1f413edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fa620640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 -- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 msgr2=0x7fb1f41e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41e0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 -- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1f406aad0 msgr2=0x7fb1f413edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1f406aad0 0x7fb1f413edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 -- 172.21.15.89:0/1414428796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009400 con 0x7fb1f4071bd0 2023-08-25T09:42:22.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1fa620640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:22.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.244+0000 7fb1f961e640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f414c4f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.245+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4039c90 con 0x7fb1f4071bd0 2023-08-25T09:42:22.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.245+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e403f040 con 0x7fb1f4071bd0 2023-08-25T09:42:22.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.245+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f414ea50 con 0x7fb1f4071bd0 2023-08-25T09:42:22.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.245+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4006e10 con 0x7fb1f4071bd0 2023-08-25T09:42:22.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.245+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f414d580 con 0x7fb1f4071bd0 2023-08-25T09:42:22.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.246+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f414c210 con 0x7fb1f4071bd0 2023-08-25T09:42:22.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.246+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1e4004030 con 0x7fb1f4071bd0 2023-08-25T09:42:22.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.246+0000 7fb1ea7fc640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb1d806a050 0x7fb1d806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.246+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb1e40aa840 con 0x7fb1f4071bd0 2023-08-25T09:42:22.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.246+0000 7fb1f9e1f640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb1d806a050 0x7fb1d806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.247+0000 7fb1f9e1f640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb1d806a050 0x7fb1d806c510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0012e0 tx=0x7fb1ec007ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.251+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb1f414c210 con 0x7fb1f4071bd0 2023-08-25T09:42:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.417+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1f414c210 con 0x7fb1f4071bd0 2023-08-25T09:42:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.418+0000 7fb1ea7fc640 1 -- 172.21.15.89:0/1414428796 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1e4048020 con 0x7fb1f4071bd0 2023-08-25T09:42:22.420 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb1d806a050 msgr2=0x7fb1d806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb1d806a050 0x7fb1d806c510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0012e0 tx=0x7fb1ec007ed0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 msgr2=0x7fb1f414c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f414c4f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e40046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 shutdown_connections 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb1d806a050 0x7fb1d806c510 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1f4071bd0 0x7fb1f414c4f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1f41447b0 0x7fb1f41e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 --2- 172.21.15.89:0/1414428796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1f406aad0 0x7fb1f413edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 >> 172.21.15.89:0/1414428796 conn(0x7fb1f40b91c0 msgr2=0x7fb1f41498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:22.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 shutdown_connections 2023-08-25T09:42:22.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.420+0000 7fb1fc083640 1 -- 172.21.15.89:0/1414428796 wait complete. 2023-08-25T09:42:22.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.529+0000 7f3d30922640 1 Processor -- start 2023-08-25T09:42:22.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.529+0000 7f3d30922640 1 -- start start 2023-08-25T09:42:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d30922640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d2c070810 0x7f3d2c14a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d30922640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c070d10 con 0x7f3d2c070430 2023-08-25T09:42:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d30922640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0699f0 con 0x7f3d2c14ae70 2023-08-25T09:42:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d30922640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c06a6b0 con 0x7f3d2c070810 2023-08-25T09:42:22.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d2a59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3d2c070430 0x7f3d2c0b3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37884/0 (socket says 172.21.15.89:37884) 2023-08-25T09:42:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d2a59c640 1 -- 172.21.15.89:0/129020241 learned_addr learned my addr 172.21.15.89:0/129020241 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588331132 0 0) 0x7f3d2c070d10 con 0x7f3d2c070430 2023-08-25T09:42:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d14003520 con 0x7f3d2c070430 2023-08-25T09:42:22.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.530+0000 7f3d29d9b640 1 --2- 172.21.15.89:0/129020241 >> v2:172.21.15.121:3300/0 conn(0x7f3d2c070810 0x7f3d2c14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534147980 0 0) 0x7f3d14003520 con 0x7f3d2c070430 2023-08-25T09:42:22.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 >> v2:172.21.15.121:3300/0 conn(0x7f3d2c070810 msgr2=0x7f3d2c14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:22.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 --2- 172.21.15.89:0/129020241 >> v2:172.21.15.121:3300/0 conn(0x7f3d2c070810 0x7f3d2c14a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 >> v1:172.21.15.121:6789/0 conn(0x7f3d2c14ae70 legacy=0x7f3d2c155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c069cd0 con 0x7f3d2c070430 2023-08-25T09:42:22.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f3d1c001670 con 0x7f3d2c070430 2023-08-25T09:42:22.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 >> v1:172.21.15.89:6789/0 conn(0x7f3d2c070430 legacy=0x7f3d2c0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d140039e0 0x7f3d14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d140047c0 0x7f3d14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d14005180 0x7f3d1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c06a6b0 con 0x7f3d14005180 2023-08-25T09:42:22.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1400c0b0 con 0x7f3d140039e0 2023-08-25T09:42:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1400c270 con 0x7f3d140047c0 2023-08-25T09:42:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2ad9d640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d14005180 0x7f3d1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2a59c640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d140039e0 0x7f3d14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d29d9b640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d140047c0 0x7f3d14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2ad9d640 1 -- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d140047c0 msgr2=0x7f3d14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2ad9d640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d140047c0 0x7f3d14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2ad9d640 1 -- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d140039e0 msgr2=0x7f3d14003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:22.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2ad9d640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d140039e0 0x7f3d14003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.531+0000 7f3d2ad9d640 1 -- 172.21.15.89:0/129020241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14003520 con 0x7f3d14005180 2023-08-25T09:42:22.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d2ad9d640 1 -- 172.21.15.89:0/129020241 reap_dead start 2023-08-25T09:42:22.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d2ad9d640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d14005180 0x7f3d1400b980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001e50 tx=0x7f3d140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a2f0d06458cd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24003b70 con 0x7f3d14005180 2023-08-25T09:42:22.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d24003cf0 con 0x7f3d14005180 2023-08-25T09:42:22.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d2959a640 1 -- 172.21.15.89:0/129020241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24005310 con 0x7f3d14005180 2023-08-25T09:42:22.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d30922640 1 -- 172.21.15.89:0/129020241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d14005180 msgr2=0x7f3d1400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d30922640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d14005180 0x7f3d1400b980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001e50 tx=0x7f3d140057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d30922640 1 -- 172.21.15.89:0/129020241 shutdown_connections 2023-08-25T09:42:22.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d30922640 1 --2- 172.21.15.89:0/129020241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d14005180 0x7f3d1400b980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d30922640 1 -- 172.21.15.89:0/129020241 >> 172.21.15.89:0/129020241 conn(0x7f3d2c0bcfc0 msgr2=0x7f3d2c0bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:22.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.532+0000 7f3d30922640 1 -- 172.21.15.89:0/129020241 shutdown_connections 2023-08-25T09:42:22.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.533+0000 7f3d30922640 1 -- 172.21.15.89:0/129020241 wait complete. 2023-08-25T09:42:22.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 Processor -- start 2023-08-25T09:42:22.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 -- start start 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d14005180 0x7f3d2c0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 0x7f3d2c147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2c147cb0 0x7f3d2c140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c070ff0 con 0x7f3d2c141a80 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b5780 con 0x7f3d2c147cb0 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d30922640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c148140 con 0x7f3d14005180 2023-08-25T09:42:22.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d29d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 0x7f3d2c147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d29d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 0x7f3d2c147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36664/0 (socket says 172.21.15.89:36664) 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.534+0000 7f3d29d9b640 1 -- 172.21.15.89:0/3096345451 learned_addr learned my addr 172.21.15.89:0/3096345451 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d2ad9d640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2c147cb0 0x7f3d2c140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d2a59c640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d14005180 0x7f3d2c0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d29d9b640 1 -- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d14005180 msgr2=0x7f3d2c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d29d9b640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d14005180 0x7f3d2c0b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d29d9b640 1 -- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2c147cb0 msgr2=0x7f3d2c140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d29d9b640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2c147cb0 0x7f3d2c140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d29d9b640 1 -- 172.21.15.89:0/3096345451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0ab8f0 con 0x7f3d2c141a80 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d29d9b640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 0x7f3d2c147770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d20011910 tx=0x7f3d20011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000fa70 con 0x7f3d2c141a80 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000fbd0 con 0x7f3d2c141a80 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20014440 con 0x7f3d2c141a80 2023-08-25T09:42:22.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c148d70 con 0x7f3d2c141a80 2023-08-25T09:42:22.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.535+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c0abbd0 con 0x7f3d2c141a80 2023-08-25T09:42:22.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.536+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c149290 con 0x7f3d2c141a80 2023-08-25T09:42:22.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.536+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d200145a0 con 0x7f3d2c141a80 2023-08-25T09:42:22.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.537+0000 7f3d1affd640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3d0c06a050 0x7f3d0c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.537+0000 7f3d2a59c640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3d0c06a050 0x7f3d0c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.537+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d20088c80 con 0x7f3d2c141a80 2023-08-25T09:42:22.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.537+0000 7f3d2a59c640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3d0c06a050 0x7f3d0c06c510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c000f60 tx=0x7f3d1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.541+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3d2c149290 con 0x7f3d2c141a80 2023-08-25T09:42:22.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.707+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d2c149290 con 0x7f3d2c141a80 2023-08-25T09:42:22.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.709+0000 7f3d1affd640 1 -- 172.21.15.89:0/3096345451 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f3d2c149290 con 0x7f3d2c141a80 2023-08-25T09:42:22.711 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:22.711 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:22.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3d0c06a050 msgr2=0x7f3d0c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3d0c06a050 0x7f3d0c06c510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c000f60 tx=0x7f3d1c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:22.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 msgr2=0x7f3d2c147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 0x7f3d2c147770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d20011910 tx=0x7f3d20011dd0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 shutdown_connections 2023-08-25T09:42:22.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3d0c06a050 0x7f3d0c06c510 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d2c141a80 0x7f3d2c147770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2c147cb0 0x7f3d2c140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 --2- 172.21.15.89:0/3096345451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d14005180 0x7f3d2c0b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.710+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 >> 172.21.15.89:0/3096345451 conn(0x7f3d2c0bcfc0 msgr2=0x7f3d2c149d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:22.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.711+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 shutdown_connections 2023-08-25T09:42:22.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.711+0000 7f3d30922640 1 -- 172.21.15.89:0/3096345451 wait complete. 2023-08-25T09:42:22.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:22.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:22.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.826+0000 7f8142eb8640 1 Processor -- start 2023-08-25T09:42:22.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.826+0000 7f8142eb8640 1 -- start start 2023-08-25T09:42:22.832 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8142eb8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f813c0b7b80 0x7f813c0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8142eb8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c06e880 con 0x7f813c070f20 2023-08-25T09:42:22.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8142eb8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c14ab90 con 0x7f813c1415c0 2023-08-25T09:42:22.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8142eb8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0b3570 con 0x7f813c0b7b80 2023-08-25T09:42:22.833 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8141455640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f813c070f20 0x7f813c151ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37892/0 (socket says 172.21.15.89:37892) 2023-08-25T09:42:22.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8141455640 1 -- 172.21.15.89:0/1151075960 learned_addr learned my addr 172.21.15.89:0/1151075960 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:22.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8140c54640 1 --2- 172.21.15.89:0/1151075960 >> v2:172.21.15.121:3300/0 conn(0x7f813c0b7b80 0x7f813c0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f813b7fe640 1 -- 172.21.15.89:0/1151075960 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446227618 0 0) 0x7f813c06e880 con 0x7f813c070f20 2023-08-25T09:42:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f813b7fe640 1 -- 172.21.15.89:0/1151075960 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8124003520 con 0x7f813c070f20 2023-08-25T09:42:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8140c54640 1 -- 172.21.15.89:0/1151075960 >> v1:172.21.15.121:6789/0 conn(0x7f813c1415c0 legacy=0x7f813c070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8140c54640 1 -- 172.21.15.89:0/1151075960 >> v1:172.21.15.89:6789/0 conn(0x7f813c070f20 legacy=0x7f813c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.835 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f813b7fe640 1 -- 172.21.15.89:0/1151075960 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 850865062 0 0) 0x7f8124003520 con 0x7f813c070f20 2023-08-25T09:42:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.827+0000 7f8140c54640 1 -- 172.21.15.89:0/1151075960 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0b3000 con 0x7f813c0b7b80 2023-08-25T09:42:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.828+0000 7f8140c54640 1 --2- 172.21.15.89:0/1151075960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c0b7b80 0x7f813c0b27a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097a0 tx=0x7f812c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54edc6f7b98dc967 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.836 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.828+0000 7f813b7fe640 1 -- 172.21.15.89:0/1151075960 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81340019f0 con 0x7f813c0b7b80 2023-08-25T09:42:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.828+0000 7f813b7fe640 1 -- 172.21.15.89:0/1151075960 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c02e050 con 0x7f813c0b7b80 2023-08-25T09:42:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.828+0000 7f813b7fe640 1 -- 172.21.15.89:0/1151075960 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c030710 con 0x7f813c0b7b80 2023-08-25T09:42:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 -- 172.21.15.89:0/1151075960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c0b7b80 msgr2=0x7f813c0b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 --2- 172.21.15.89:0/1151075960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c0b7b80 0x7f813c0b27a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097a0 tx=0x7f812c02b790 comp rx=0 tx=0).stop 2023-08-25T09:42:22.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 -- 172.21.15.89:0/1151075960 shutdown_connections 2023-08-25T09:42:22.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 --2- 172.21.15.89:0/1151075960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c0b7b80 0x7f813c0b27a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 -- 172.21.15.89:0/1151075960 >> 172.21.15.89:0/1151075960 conn(0x7f813c0bbe80 msgr2=0x7f813c0bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:22.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 -- 172.21.15.89:0/1151075960 shutdown_connections 2023-08-25T09:42:22.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.829+0000 7f8142eb8640 1 -- 172.21.15.89:0/1151075960 wait complete. 2023-08-25T09:42:22.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.830+0000 7f8142eb8640 1 Processor -- start 2023-08-25T09:42:22.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.830+0000 7f8142eb8640 1 -- start start 2023-08-25T09:42:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 0x7f813c0baad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c1415c0 0x7f813c1d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f813c0b4aa0 0x7f813c135250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c1d54e0 con 0x7f813c0b7b80 2023-08-25T09:42:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0b5e10 con 0x7f813c1415c0 2023-08-25T09:42:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0ba120 con 0x7f813c0b4aa0 2023-08-25T09:42:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 0x7f813c0baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 0x7f813c0baad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36678/0 (socket says 172.21.15.89:36678) 2023-08-25T09:42:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 -- 172.21.15.89:0/2395617944 learned_addr learned my addr 172.21.15.89:0/2395617944 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f813bfff640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c1415c0 0x7f813c1d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8141455640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f813c0b4aa0 0x7f813c135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 -- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f813c0b4aa0 msgr2=0x7f813c135250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f813c0b4aa0 0x7f813c135250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 -- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c1415c0 msgr2=0x7f813c1d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c1415c0 0x7f813c1d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 -- 172.21.15.89:0/2395617944 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009400 con 0x7f813c0b7b80 2023-08-25T09:42:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8141455640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f813c0b4aa0 0x7f813c135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8140c54640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 0x7f813c0baad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f812c02b7d0 tx=0x7f812c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c03d890 con 0x7f813c0b7b80 2023-08-25T09:42:22.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c03da30 con 0x7f813c0b7b80 2023-08-25T09:42:22.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0b5b30 con 0x7f813c0b7b80 2023-08-25T09:42:22.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.831+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c03dde0 con 0x7f813c0b7b80 2023-08-25T09:42:22.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.832+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c0b4f60 con 0x7f813c0b7b80 2023-08-25T09:42:22.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.832+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c04dc40 con 0x7f813c0b7b80 2023-08-25T09:42:22.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.833+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f812c039040 con 0x7f813c0b7b80 2023-08-25T09:42:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.833+0000 7f81397fa640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f812806a080 0x7f812806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.833+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f812c0aa3e0 con 0x7f813c0b7b80 2023-08-25T09:42:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.833+0000 7f813bfff640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f812806a080 0x7f812806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.833+0000 7f813bfff640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f812806a080 0x7f812806c540 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f813c1d9ff0 tx=0x7f8130009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:22.837+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f812c075d10 con 0x7f813c0b7b80 2023-08-25T09:42:23.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.002+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f813c06e660 con 0x7f813c0b7b80 2023-08-25T09:42:23.006 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.002+0000 7f81397fa640 1 -- 172.21.15.89:0/2395617944 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f812c079330 con 0x7f813c0b7b80 2023-08-25T09:42:23.006 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:23.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f812806a080 msgr2=0x7f812806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f812806a080 0x7f812806c540 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f813c1d9ff0 tx=0x7f8130009040 comp rx=0 tx=0).stop 2023-08-25T09:42:23.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 msgr2=0x7f813c0baad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 0x7f813c0baad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f812c02b7d0 tx=0x7f812c0046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 shutdown_connections 2023-08-25T09:42:23.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f812806a080 0x7f812806c540 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f813c0b4aa0 0x7f813c135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f813c1415c0 0x7f813c1d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 --2- 172.21.15.89:0/2395617944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f813c0b7b80 0x7f813c0baad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 >> 172.21.15.89:0/2395617944 conn(0x7f813c0bbe80 msgr2=0x7f813c0b7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 shutdown_connections 2023-08-25T09:42:23.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.004+0000 7f8142eb8640 1 -- 172.21.15.89:0/2395617944 wait complete. 2023-08-25T09:42:23.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:23.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.117+0000 7f9c20979640 1 Processor -- start 2023-08-25T09:42:23.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.117+0000 7f9c20979640 1 -- start start 2023-08-25T09:42:23.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c20979640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c1415c0 0x7f9c1c141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c20979640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 0x7f9c1c070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c20979640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c06e880 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c20979640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c0b3570 con 0x7f9c1c070810 2023-08-25T09:42:23.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c20979640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0711c0 con 0x7f9c1c1415c0 2023-08-25T09:42:23.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c19d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c1415c0 0x7f9c1c141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c1ad9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 0x7f9c1c070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c1ad9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 0x7f9c1c070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:45796/0 (socket says 172.21.15.89:45796) 2023-08-25T09:42:23.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c1a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9c1c0b7b80 0x7f9c1c0b27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:47328/0 (socket says 172.21.15.89:47328) 2023-08-25T09:42:23.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c1ad9d640 1 -- 172.21.15.89:0/3772837480 learned_addr learned my addr 172.21.15.89:0/3772837480 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:23.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c1959a640 1 -- 172.21.15.89:0/3772837480 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691672927 0 0) 0x7f9c1c06e880 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c19d9b640 1 -- 172.21.15.89:0/3772837480 >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 msgr2=0x7f9c1c070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:23.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c19d9b640 1 --2- 172.21.15.89:0/3772837480 >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 0x7f9c1c070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c19d9b640 1 -- 172.21.15.89:0/3772837480 >> v1:172.21.15.121:6789/0 conn(0x7f9c1c0b7b80 legacy=0x7f9c1c0b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c19d9b640 1 -- 172.21.15.89:0/3772837480 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c14ab90 con 0x7f9c1c1415c0 2023-08-25T09:42:23.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.118+0000 7f9c1ad9d640 1 --2- 172.21.15.89:0/3772837480 >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 0x7f9c1c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:23.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.119+0000 7f9c19d9b640 1 --2- 172.21.15.89:0/3772837480 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c1415c0 0x7f9c1c141a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097a0 tx=0x7f9c1002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=259e6375ecaecbff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.119+0000 7f9c1959a640 1 -- 172.21.15.89:0/3772837480 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10031830 con 0x7f9c1c1415c0 2023-08-25T09:42:23.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.119+0000 7f9c1959a640 1 -- 172.21.15.89:0/3772837480 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c10031990 con 0x7f9c1c1415c0 2023-08-25T09:42:23.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.119+0000 7f9c1959a640 1 -- 172.21.15.89:0/3772837480 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10031d20 con 0x7f9c1c1415c0 2023-08-25T09:42:23.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 -- 172.21.15.89:0/3772837480 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c1415c0 msgr2=0x7f9c1c141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 --2- 172.21.15.89:0/3772837480 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c1415c0 0x7f9c1c141a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097a0 tx=0x7f9c1002b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 -- 172.21.15.89:0/3772837480 shutdown_connections 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 --2- 172.21.15.89:0/3772837480 >> v2:172.21.15.121:3300/0 conn(0x7f9c1c070810 0x7f9c1c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 --2- 172.21.15.89:0/3772837480 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c1415c0 0x7f9c1c141a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 -- 172.21.15.89:0/3772837480 >> 172.21.15.89:0/3772837480 conn(0x7f9c1c0bbe80 msgr2=0x7f9c1c0bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 -- 172.21.15.89:0/3772837480 shutdown_connections 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.120+0000 7f9c20979640 1 -- 172.21.15.89:0/3772837480 wait complete. 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.121+0000 7f9c20979640 1 Processor -- start 2023-08-25T09:42:23.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.121+0000 7f9c20979640 1 -- start start 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c20979640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c070810 0x7f9c1c13ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c20979640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 0x7f9c1c13dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c20979640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c1c1415c0 0x7f9c1c13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c20979640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c13e1d0 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c20979640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c14a9d0 con 0x7f9c1c1415c0 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c20979640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c13d500 con 0x7f9c1c070810 2023-08-25T09:42:23.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 0x7f9c1c13dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 0x7f9c1c13dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36684/0 (socket says 172.21.15.89:36684) 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 -- 172.21.15.89:0/2381224379 learned_addr learned my addr 172.21.15.89:0/2381224379 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c1ad9d640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c1c1415c0 0x7f9c1c13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c1a59c640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c070810 0x7f9c1c13ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 -- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c070810 msgr2=0x7f9c1c13ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c070810 0x7f9c1c13ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 -- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c1c1415c0 msgr2=0x7f9c1c13a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c1c1415c0 0x7f9c1c13a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 -- 172.21.15.89:0/2381224379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14009b30 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c1ad9d640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c1c1415c0 0x7f9c1c13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.122+0000 7f9c19d9b640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 0x7f9c1c13dc90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097a0 tx=0x7f9c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.123+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10004230 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.123+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c10004390 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.123+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c10009400 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.123+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1003a870 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.123+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c14a380 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.124+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c14a1d0 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.124+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c1003a9d0 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.124+0000 7f9c0affd640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9bfc06a050 0x7f9bfc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.124+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c100aa500 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.124+0000 7f9c1a59c640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9bfc06a050 0x7f9bfc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.125+0000 7f9c1a59c640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9bfc06a050 0x7f9bfc06c510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c000f60 tx=0x7f9c0c007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.129+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9c10075d30 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.294+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c1c04dc40 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.295+0000 7f9c0affd640 1 -- 172.21.15.89:0/2381224379 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c10079350 con 0x7f9c1c0b7b80 2023-08-25T09:42:23.298 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:23.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9bfc06a050 msgr2=0x7f9bfc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9bfc06a050 0x7f9bfc06c510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c000f60 tx=0x7f9c0c007d50 comp rx=0 tx=0).stop 2023-08-25T09:42:23.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 msgr2=0x7f9c1c13dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 0x7f9c1c13dc90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097a0 tx=0x7f9c100046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 shutdown_connections 2023-08-25T09:42:23.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9bfc06a050 0x7f9bfc06c510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c1c0b7b80 0x7f9c1c13dc90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c1c1415c0 0x7f9c1c13a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 --2- 172.21.15.89:0/2381224379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c1c070810 0x7f9c1c13ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 >> 172.21.15.89:0/2381224379 conn(0x7f9c1c0bbe80 msgr2=0x7f9c1c0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 shutdown_connections 2023-08-25T09:42:23.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.297+0000 7f9c20979640 1 -- 172.21.15.89:0/2381224379 wait complete. 2023-08-25T09:42:23.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:23.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.410+0000 7f9fc54c5640 1 Processor -- start 2023-08-25T09:42:23.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.410+0000 7f9fc54c5640 1 -- start start 2023-08-25T09:42:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fc54c5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9fc00bcf70 0x7f9fc00bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fc54c5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fc014a9a0 0x7f9fc014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fc54c5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00ba300 con 0x7f9fc0144560 2023-08-25T09:42:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fc54c5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00b9640 con 0x7f9fc014a9a0 2023-08-25T09:42:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fc54c5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00bcb40 con 0x7f9fc00bcf70 2023-08-25T09:42:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fc014a9a0 0x7f9fc014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fc014a9a0 0x7f9fc014adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36686/0 (socket says 172.21.15.89:36686) 2023-08-25T09:42:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fb7fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9fc0144560 0x7f9fc01449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37894/0 (socket says 172.21.15.89:37894) 2023-08-25T09:42:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 -- 172.21.15.89:0/4057308548 learned_addr learned my addr 172.21.15.89:0/4057308548 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbeffd640 1 --2- 172.21.15.89:0/4057308548 >> v2:172.21.15.121:3300/0 conn(0x7f9fc00bcf70 0x7f9fc00bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 -- 172.21.15.89:0/4057308548 >> v2:172.21.15.121:3300/0 conn(0x7f9fc00bcf70 msgr2=0x7f9fc00bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 --2- 172.21.15.89:0/4057308548 >> v2:172.21.15.121:3300/0 conn(0x7f9fc00bcf70 0x7f9fc00bc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 -- 172.21.15.89:0/4057308548 >> v1:172.21.15.89:6789/0 conn(0x7f9fc0144560 legacy=0x7f9fc01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbf7fe640 1 -- 172.21.15.89:0/4057308548 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00bc8c0 con 0x7f9fc014a9a0 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.411+0000 7f9fbe7fc640 1 -- 172.21.15.89:0/4057308548 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304049432 0 0) 0x7f9fc00ba300 con 0x7f9fc0144560 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fbf7fe640 1 --2- 172.21.15.89:0/4057308548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc014a9a0 0x7f9fc014adc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00bd6b0 tx=0x7f9fb802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf8088b22124994 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fbe7fc640 1 -- 172.21.15.89:0/4057308548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb802cb20 con 0x7f9fc014a9a0 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fbe7fc640 1 -- 172.21.15.89:0/4057308548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb802cc80 con 0x7f9fc014a9a0 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fbe7fc640 1 -- 172.21.15.89:0/4057308548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80343f0 con 0x7f9fc014a9a0 2023-08-25T09:42:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 -- 172.21.15.89:0/4057308548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc014a9a0 msgr2=0x7f9fc014adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/4057308548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc014a9a0 0x7f9fc014adc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00bd6b0 tx=0x7f9fb802bf80 comp rx=0 tx=0).stop 2023-08-25T09:42:23.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 -- 172.21.15.89:0/4057308548 shutdown_connections 2023-08-25T09:42:23.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/4057308548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc014a9a0 0x7f9fc014adc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/4057308548 >> v2:172.21.15.121:3300/0 conn(0x7f9fc00bcf70 0x7f9fc00bc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 -- 172.21.15.89:0/4057308548 >> 172.21.15.89:0/4057308548 conn(0x7f9fc00654f0 msgr2=0x7f9fc00658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.412+0000 7f9fc54c5640 1 -- 172.21.15.89:0/4057308548 shutdown_connections 2023-08-25T09:42:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.413+0000 7f9fc54c5640 1 -- 172.21.15.89:0/4057308548 wait complete. 2023-08-25T09:42:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.413+0000 7f9fc54c5640 1 Processor -- start 2023-08-25T09:42:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.413+0000 7f9fc54c5640 1 -- start start 2023-08-25T09:42:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fc54c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 0x7f9fc014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fc54c5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fc0144560 0x7f9fc014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fc54c5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fc014a9a0 0x7f9fc014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fc54c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc014d3f0 con 0x7f9fc00bcf70 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fc54c5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01e0110 con 0x7f9fc0144560 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fc54c5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01df590 con 0x7f9fc014a9a0 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 0x7f9fc014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 0x7f9fc014ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36688/0 (socket says 172.21.15.89:36688) 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 -- 172.21.15.89:0/2839236672 learned_addr learned my addr 172.21.15.89:0/2839236672 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 -- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fc014a9a0 msgr2=0x7f9fc014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fc014a9a0 0x7f9fc014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 -- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fc0144560 msgr2=0x7f9fc014b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fb7fff640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fc0144560 0x7f9fc014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fc0144560 0x7f9fc014b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fbeffd640 1 -- 172.21.15.89:0/2839236672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8009b30 con 0x7f9fc00bcf70 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.414+0000 7f9fb7fff640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fc0144560 0x7f9fc014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.415+0000 7f9fbeffd640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 0x7f9fc014ceb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000d800 tx=0x7f9fb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.415+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000b6c0 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.415+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000b820 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.415+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000bbb0 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.415+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01df7e0 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.415+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc01dfda0 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.416+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc004dc40 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.416+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9fb000bd10 con 0x7f9fc00bcf70 2023-08-25T09:42:23.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.416+0000 7f9fb77fe640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9fa006a050 0x7f9fa006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.416+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fb0088a90 con 0x7f9fc00bcf70 2023-08-25T09:42:23.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.416+0000 7f9fb7fff640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9fa006a050 0x7f9fa006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.417+0000 7f9fb7fff640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9fa006a050 0x7f9fa006c510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9fc014a5b0 tx=0x7f9fa8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.421+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9fb0054210 con 0x7f9fc00bcf70 2023-08-25T09:42:23.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.587+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fc00b35b0 con 0x7f9fc00bcf70 2023-08-25T09:42:23.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.587+0000 7f9fb77fe640 1 -- 172.21.15.89:0/2839236672 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9fb0057830 con 0x7f9fc00bcf70 2023-08-25T09:42:23.590 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:23.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9fa006a050 msgr2=0x7f9fa006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9fa006a050 0x7f9fa006c510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9fc014a5b0 tx=0x7f9fa8009040 comp rx=0 tx=0).stop 2023-08-25T09:42:23.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 msgr2=0x7f9fc014ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.592 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 0x7f9fc014ceb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000d800 tx=0x7f9fb000dcc0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 shutdown_connections 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9fa006a050 0x7f9fa006c510 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fc014a9a0 0x7f9fc014be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fc0144560 0x7f9fc014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 --2- 172.21.15.89:0/2839236672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fc00bcf70 0x7f9fc014ceb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 >> 172.21.15.89:0/2839236672 conn(0x7f9fc00654f0 msgr2=0x7f9fc00be160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.593 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 shutdown_connections 2023-08-25T09:42:23.594 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.589+0000 7f9fc54c5640 1 -- 172.21.15.89:0/2839236672 wait complete. 2023-08-25T09:42:23.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:23.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.701+0000 7f41e9ee7640 1 Processor -- start 2023-08-25T09:42:23.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.701+0000 7f41e9ee7640 1 -- start start 2023-08-25T09:42:23.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e9ee7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 0x7f41e40b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e9ee7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f41e4142c00 0x7f41e40b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e9ee7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e40ba0e0 con 0x7f41e40b7950 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e9ee7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e40b7db0 con 0x7f41e4142c00 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e9ee7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40b9830 con 0x7f41e40b6890 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 0x7f41e40b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f41e4142c00 0x7f41e40b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 0x7f41e40b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:58466/0 (socket says 172.21.15.89:58466) 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 -- 172.21.15.89:0/90589681 learned_addr learned my addr 172.21.15.89:0/90589681 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:23.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 -- 172.21.15.89:0/90589681 >> v2:172.21.15.121:3300/0 conn(0x7f41e4142c00 msgr2=0x7f41e40b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:23.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 --2- 172.21.15.89:0/90589681 >> v2:172.21.15.121:3300/0 conn(0x7f41e4142c00 0x7f41e40b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 -- 172.21.15.89:0/90589681 >> v1:172.21.15.121:6789/0 conn(0x7f41e40b7950 legacy=0x7f41e41424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e37fe640 1 -- 172.21.15.89:0/90589681 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e40ba350 con 0x7f41e40b6890 2023-08-25T09:42:23.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.702+0000 7f41e3fff640 1 --2- 172.21.15.89:0/90589681 >> v2:172.21.15.121:3300/0 conn(0x7f41e4142c00 0x7f41e40b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:23.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.703+0000 7f41e37fe640 1 --2- 172.21.15.89:0/90589681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 0x7f41e40b8290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b797b46db3e3b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.703+0000 7f41e27fc640 1 -- 172.21.15.89:0/90589681 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d402f840 con 0x7f41e40b6890 2023-08-25T09:42:23.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.703+0000 7f41e27fc640 1 -- 172.21.15.89:0/90589681 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d402f9a0 con 0x7f41e40b6890 2023-08-25T09:42:23.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.703+0000 7f41e27fc640 1 -- 172.21.15.89:0/90589681 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d402fd30 con 0x7f41e40b6890 2023-08-25T09:42:23.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 -- 172.21.15.89:0/90589681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 msgr2=0x7f41e40b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/90589681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 0x7f41e40b8290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009870 tx=0x7f41d402ba20 comp rx=0 tx=0).stop 2023-08-25T09:42:23.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 -- 172.21.15.89:0/90589681 shutdown_connections 2023-08-25T09:42:23.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/90589681 >> v2:172.21.15.121:3300/0 conn(0x7f41e4142c00 0x7f41e40b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/90589681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e40b6890 0x7f41e40b8290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 -- 172.21.15.89:0/90589681 >> 172.21.15.89:0/90589681 conn(0x7f41e406d350 msgr2=0x7f41e406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 -- 172.21.15.89:0/90589681 shutdown_connections 2023-08-25T09:42:23.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.704+0000 7f41e9ee7640 1 -- 172.21.15.89:0/90589681 wait complete. 2023-08-25T09:42:23.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.705+0000 7f41e9ee7640 1 Processor -- start 2023-08-25T09:42:23.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.705+0000 7f41e9ee7640 1 -- start start 2023-08-25T09:42:23.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 0x7f41e41440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41e40b7950 0x7f41e414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e4142c00 0x7f41e4148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e41494d0 con 0x7f41e40b6890 2023-08-25T09:42:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e414a0c0 con 0x7f41e40b7950 2023-08-25T09:42:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e414a3a0 con 0x7f41e4142c00 2023-08-25T09:42:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 0x7f41e41440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 0x7f41e41440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36700/0 (socket says 172.21.15.89:36700) 2023-08-25T09:42:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 -- 172.21.15.89:0/1263449757 learned_addr learned my addr 172.21.15.89:0/1263449757 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e2ffd640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41e40b7950 0x7f41e414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e3fff640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e4142c00 0x7f41e4148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 -- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e4142c00 msgr2=0x7f41e4148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e4142c00 0x7f41e4148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 -- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41e40b7950 msgr2=0x7f41e414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41e40b7950 0x7f41e414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 -- 172.21.15.89:0/1263449757 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc009a70 con 0x7f41e40b6890 2023-08-25T09:42:23.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e37fe640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 0x7f41e41440c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f41d4000c00 tx=0x7f41d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d403b040 con 0x7f41e40b6890 2023-08-25T09:42:23.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4037c40 con 0x7f41e40b6890 2023-08-25T09:42:23.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d40094d0 con 0x7f41e40b6890 2023-08-25T09:42:23.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4042480 con 0x7f41e40b6890 2023-08-25T09:42:23.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.706+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e414a960 con 0x7f41e40b6890 2023-08-25T09:42:23.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.707+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e414a200 con 0x7f41e40b6890 2023-08-25T09:42:23.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.708+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f41d4042600 con 0x7f41e40b6890 2023-08-25T09:42:23.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.708+0000 7f41cbfff640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f41d006a080 0x7f41d006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:23.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.708+0000 7f41e2ffd640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f41d006a080 0x7f41d006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:23.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.708+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41d40ab570 con 0x7f41e40b6890 2023-08-25T09:42:23.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.709+0000 7f41e2ffd640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f41d006a080 0x7f41d006c540 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41e40bc470 tx=0x7f41d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:23.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.712+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f41e414a200 con 0x7f41e40b6890 2023-08-25T09:42:23.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.878+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41e414a200 con 0x7f41e40b6890 2023-08-25T09:42:23.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.878+0000 7f41cbfff640 1 -- 172.21.15.89:0/1263449757 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41e414a200 con 0x7f41e40b6890 2023-08-25T09:42:23.880 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:23.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f41d006a080 msgr2=0x7f41d006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f41d006a080 0x7f41d006c540 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41e40bc470 tx=0x7f41d8009040 comp rx=0 tx=0).stop 2023-08-25T09:42:23.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 msgr2=0x7f41e41440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:23.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 0x7f41e41440c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f41d4000c00 tx=0x7f41d40046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 shutdown_connections 2023-08-25T09:42:23.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f41d006a080 0x7f41d006c540 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41e4142c00 0x7f41e4148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41e40b7950 0x7f41e414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 --2- 172.21.15.89:0/1263449757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41e40b6890 0x7f41e41440c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:23.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 >> 172.21.15.89:0/1263449757 conn(0x7f41e406d350 msgr2=0x7f41e40b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 shutdown_connections 2023-08-25T09:42:23.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:23.880+0000 7f41e9ee7640 1 -- 172.21.15.89:0/1263449757 wait complete. 2023-08-25T09:42:23.960 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-08-25T09:42:23.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:24.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 Processor -- start 2023-08-25T09:42:24.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 -- start start 2023-08-25T09:42:24.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f740006eba0 0x7f740006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74001494a0 0x7f740006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7400149010 con 0x7f74000b4a90 2023-08-25T09:42:24.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74000b52e0 con 0x7f74001494a0 2023-08-25T09:42:24.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f7405d55640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740006e550 con 0x7f740006eba0 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f73feffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74001494a0 0x7f740006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f73feffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74001494a0 0x7f740006d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36708/0 (socket says 172.21.15.89:36708) 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.059+0000 7f73feffd640 1 -- 172.21.15.89:0/1567532725 learned_addr learned my addr 172.21.15.89:0/1567532725 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.060+0000 7f73ff7fe640 1 --2- 172.21.15.89:0/1567532725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f740006eba0 0x7f740006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.060+0000 7f73feffd640 1 -- 172.21.15.89:0/1567532725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f740006eba0 msgr2=0x7f740006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.060+0000 7f73feffd640 1 --2- 172.21.15.89:0/1567532725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f740006eba0 0x7f740006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.063 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.060+0000 7f73feffd640 1 -- 172.21.15.89:0/1567532725 >> v1:172.21.15.121:6789/0 conn(0x7f74000b4a90 legacy=0x7f74000b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.060+0000 7f73feffd640 1 -- 172.21.15.89:0/1567532725 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74001489c0 con 0x7f74001494a0 2023-08-25T09:42:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.060+0000 7f73feffd640 1 --2- 172.21.15.89:0/1567532725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001494a0 0x7f740006d1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009870 tx=0x7f73f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316d3e7cb08e7b7c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f73fe7fc640 1 -- 172.21.15.89:0/1567532725 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0031640 con 0x7f74001494a0 2023-08-25T09:42:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f73fe7fc640 1 -- 172.21.15.89:0/1567532725 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00317a0 con 0x7f74001494a0 2023-08-25T09:42:24.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f73fe7fc640 1 -- 172.21.15.89:0/1567532725 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0031b30 con 0x7f74001494a0 2023-08-25T09:42:24.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 -- 172.21.15.89:0/1567532725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001494a0 msgr2=0x7f740006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 --2- 172.21.15.89:0/1567532725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001494a0 0x7f740006d1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009870 tx=0x7f73f002b8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 -- 172.21.15.89:0/1567532725 shutdown_connections 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 --2- 172.21.15.89:0/1567532725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001494a0 0x7f740006d1d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 --2- 172.21.15.89:0/1567532725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f740006eba0 0x7f740006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 -- 172.21.15.89:0/1567532725 >> 172.21.15.89:0/1567532725 conn(0x7f74000be090 msgr2=0x7f74000be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 -- 172.21.15.89:0/1567532725 shutdown_connections 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.061+0000 7f7405d55640 1 -- 172.21.15.89:0/1567532725 wait complete. 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.062+0000 7f7405d55640 1 Processor -- start 2023-08-25T09:42:24.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.062+0000 7f7405d55640 1 -- start start 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f7405d55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f740006eba0 0x7f740014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f7405d55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 0x7f74000b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f7405d55640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74001494a0 0x7f74001e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f7405d55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740014c4a0 con 0x7f74000b4a90 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f7405d55640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74000b5420 con 0x7f740006eba0 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f7405d55640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74000b5cc0 con 0x7f74001494a0 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 0x7f74000b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 0x7f74000b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36712/0 (socket says 172.21.15.89:36712) 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 -- 172.21.15.89:0/3131176014 learned_addr learned my addr 172.21.15.89:0/3131176014 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73ff7fe640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f740006eba0 0x7f740014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73fffff640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74001494a0 0x7f74001e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 -- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74001494a0 msgr2=0x7f74001e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74001494a0 0x7f74001e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 -- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f740006eba0 msgr2=0x7f740014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f740006eba0 0x7f740014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 -- 172.21.15.89:0/3131176014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00094d0 con 0x7f74000b4a90 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.063+0000 7f73feffd640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 0x7f74000b7bb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009870 tx=0x7f73f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.064+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f003ac60 con 0x7f74000b4a90 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.064+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f003ade0 con 0x7f74000b4a90 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.064+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74000b6150 con 0x7f74000b4a90 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.064+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0044630 con 0x7f74000b4a90 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.064+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740014c910 con 0x7f74000b4a90 2023-08-25T09:42:24.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.065+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7400066c50 con 0x7f74000b4a90 2023-08-25T09:42:24.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.065+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73f002f050 con 0x7f74000b4a90 2023-08-25T09:42:24.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.065+0000 7f73e7fff640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f73ec06a080 0x7f73ec06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.065+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73f00aa350 con 0x7f74000b4a90 2023-08-25T09:42:24.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.065+0000 7f73ff7fe640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f73ec06a080 0x7f73ec06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.066+0000 7f73ff7fe640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f73ec06a080 0x7f73ec06c540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73f4006a30 tx=0x7f73f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.069+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73f0075a40 con 0x7f74000b4a90 2023-08-25T09:42:24.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.236+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74000b5e00 con 0x7f74000b4a90 2023-08-25T09:42:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.237+0000 7f73e7fff640 1 -- 172.21.15.89:0/3131176014 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f73f0031e60 con 0x7f74000b4a90 2023-08-25T09:42:24.238 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:24.239 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:24.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f73ec06a080 msgr2=0x7f73ec06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f73ec06a080 0x7f73ec06c540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73f4006a30 tx=0x7f73f4008040 comp rx=0 tx=0).stop 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 msgr2=0x7f74000b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 0x7f74000b7bb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009870 tx=0x7f73f00046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 shutdown_connections 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f73ec06a080 0x7f73ec06c540 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74000b4a90 0x7f74000b7bb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74001494a0 0x7f74001e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 --2- 172.21.15.89:0/3131176014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f740006eba0 0x7f740014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 >> 172.21.15.89:0/3131176014 conn(0x7f74000be090 msgr2=0x7f7400146f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 shutdown_connections 2023-08-25T09:42:24.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.239+0000 7f7405d55640 1 -- 172.21.15.89:0/3131176014 wait complete. 2023-08-25T09:42:24.251 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:24.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:24.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 Processor -- start 2023-08-25T09:42:24.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 -- start start 2023-08-25T09:42:24.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc14e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58cc0bab10 0x7f58cc155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc0b7fd0 con 0x7f58cc0b7bf0 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc14ad40 con 0x7f58cc0bab10 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d2457640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc14eed0 con 0x7f58cc14a920 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d09f4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58cc0bab10 0x7f58cc155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d09f4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58cc0bab10 0x7f58cc155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36728/0 (socket says 172.21.15.89:36728) 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58cbfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f58cc0b7bf0 0x7f58cc06a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37900/0 (socket says 172.21.15.89:37900) 2023-08-25T09:42:24.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.352+0000 7f58d09f4640 1 -- 172.21.15.89:0/3935018143 learned_addr learned my addr 172.21.15.89:0/3935018143 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58d09f4640 1 -- 172.21.15.89:0/3935018143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 msgr2=0x7f58cc14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:24.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58cb7fe640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58d09f4640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58d09f4640 1 -- 172.21.15.89:0/3935018143 >> v1:172.21.15.89:6789/0 conn(0x7f58cc0b7bf0 legacy=0x7f58cc06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58caffd640 1 -- 172.21.15.89:0/3935018143 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247941121 0 0) 0x7f58bc001110 con 0x7f58cc0b7bf0 2023-08-25T09:42:24.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58d09f4640 1 -- 172.21.15.89:0/3935018143 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0b5230 con 0x7f58cc0bab10 2023-08-25T09:42:24.358 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58cb7fe640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:24.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.353+0000 7f58d09f4640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc155280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009e50 tx=0x7f58c402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8b0d64061024d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58caffd640 1 -- 172.21.15.89:0/3935018143 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c402c9e0 con 0x7f58cc0bab10 2023-08-25T09:42:24.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58caffd640 1 -- 172.21.15.89:0/3935018143 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c402cb40 con 0x7f58cc0bab10 2023-08-25T09:42:24.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58caffd640 1 -- 172.21.15.89:0/3935018143 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40343f0 con 0x7f58cc0bab10 2023-08-25T09:42:24.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 -- 172.21.15.89:0/3935018143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 msgr2=0x7f58cc155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc155280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009e50 tx=0x7f58c402be40 comp rx=0 tx=0).stop 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 -- 172.21.15.89:0/3935018143 shutdown_connections 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc155280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 --2- 172.21.15.89:0/3935018143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 -- 172.21.15.89:0/3935018143 >> 172.21.15.89:0/3935018143 conn(0x7f58cc06e560 msgr2=0x7f58cc06e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 -- 172.21.15.89:0/3935018143 shutdown_connections 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.354+0000 7f58d2457640 1 -- 172.21.15.89:0/3935018143 wait complete. 2023-08-25T09:42:24.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.355+0000 7f58d2457640 1 Processor -- start 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.355+0000 7f58d2457640 1 -- start start 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d2457640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58cc0b7bf0 0x7f58cc0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d2457640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc0be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d2457640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d2457640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0b4c40 con 0x7f58cc0bab10 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d2457640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc146e30 con 0x7f58cc0b7bf0 2023-08-25T09:42:24.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d2457640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc146a60 con 0x7f58cc14a920 2023-08-25T09:42:24.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc0be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc0be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36734/0 (socket says 172.21.15.89:36734) 2023-08-25T09:42:24.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 -- 172.21.15.89:0/3784714541 learned_addr learned my addr 172.21.15.89:0/3784714541 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cbfff640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58cc0b7bf0 0x7f58cc0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58d09f4640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 -- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 msgr2=0x7f58cc143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 -- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58cc0b7bf0 msgr2=0x7f58cc0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58cc0b7bf0 0x7f58cc0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cb7fe640 1 -- 172.21.15.89:0/3784714541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009b30 con 0x7f58cc0bab10 2023-08-25T09:42:24.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.356+0000 7f58cbfff640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58cc0b7bf0 0x7f58cc0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:24.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.357+0000 7f58cb7fe640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc0be1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c820 tx=0x7f58c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.357+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0007a30 con 0x7f58cc0bab10 2023-08-25T09:42:24.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.357+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0007b90 con 0x7f58cc0bab10 2023-08-25T09:42:24.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.357+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc147640 con 0x7f58cc0bab10 2023-08-25T09:42:24.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.357+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000ce10 con 0x7f58cc0bab10 2023-08-25T09:42:24.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.357+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc146830 con 0x7f58cc0bab10 2023-08-25T09:42:24.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.358+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc146c00 con 0x7f58cc0bab10 2023-08-25T09:42:24.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.358+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58c00113f0 con 0x7f58cc0bab10 2023-08-25T09:42:24.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.358+0000 7f58c8ff9640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b806a050 0x7f58b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.359+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58c0088660 con 0x7f58cc0bab10 2023-08-25T09:42:24.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.359+0000 7f58cbfff640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b806a050 0x7f58b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.359+0000 7f58cbfff640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b806a050 0x7f58b806c510 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f58bc000f60 tx=0x7f58bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.363+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f58cc146c00 con 0x7f58cc0bab10 2023-08-25T09:42:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.529+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58cc146fa0 con 0x7f58cc0bab10 2023-08-25T09:42:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.529+0000 7f58c8ff9640 1 -- 172.21.15.89:0/3784714541 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58cc146fa0 con 0x7f58cc0bab10 2023-08-25T09:42:24.532 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:24.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b806a050 msgr2=0x7f58b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b806a050 0x7f58b806c510 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f58bc000f60 tx=0x7f58bc009040 comp rx=0 tx=0).stop 2023-08-25T09:42:24.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 msgr2=0x7f58cc0be1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc0be1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58c000c820 tx=0x7f58c000cce0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 shutdown_connections 2023-08-25T09:42:24.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b806a050 0x7f58b806c510 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc0bab10 0x7f58cc0be1d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58cc14a920 0x7f58cc143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 --2- 172.21.15.89:0/3784714541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58cc0b7bf0 0x7f58cc0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 >> 172.21.15.89:0/3784714541 conn(0x7f58cc06e560 msgr2=0x7f58cc0b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 shutdown_connections 2023-08-25T09:42:24.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.531+0000 7f58d2457640 1 -- 172.21.15.89:0/3784714541 wait complete. 2023-08-25T09:42:24.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:24.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 Processor -- start 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 -- start start 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28100b68d0 0x7f281006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f28100715a0 0x7f2810069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28100b6cb0 con 0x7f281014a970 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281014ae50 con 0x7f28100b68d0 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.646+0000 7f2816d96640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281014b130 con 0x7f28100715a0 2023-08-25T09:42:24.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28100b68d0 0x7f281006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28100b68d0 0x7f281006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36738/0 (socket says 172.21.15.89:36738) 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 -- 172.21.15.89:0/2824276212 learned_addr learned my addr 172.21.15.89:0/2824276212 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2815333640 1 --1- 172.21.15.89:0/2824276212 >> v1:172.21.15.89:6789/0 conn(0x7f281014a970 0x7f28100b9a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37912/0 (socket says 172.21.15.89:37912) 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f280ffff640 1 --2- 172.21.15.89:0/2824276212 >> v2:172.21.15.121:3300/0 conn(0x7f28100715a0 0x7f2810069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 -- 172.21.15.89:0/2824276212 >> v2:172.21.15.121:3300/0 conn(0x7f28100715a0 msgr2=0x7f2810069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 --2- 172.21.15.89:0/2824276212 >> v2:172.21.15.121:3300/0 conn(0x7f28100715a0 0x7f2810069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 -- 172.21.15.89:0/2824276212 >> v1:172.21.15.89:6789/0 conn(0x7f281014a970 legacy=0x7f28100b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f2814b32640 1 -- 172.21.15.89:0/2824276212 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281014b410 con 0x7f28100b68d0 2023-08-25T09:42:24.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.647+0000 7f280ffff640 1 --2- 172.21.15.89:0/2824276212 >> v2:172.21.15.121:3300/0 conn(0x7f28100715a0 0x7f2810069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2814b32640 1 --2- 172.21.15.89:0/2824276212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100b68d0 0x7f281006fd00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f281006be10 tx=0x7f280402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebfe7b0d70ca55 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f280f7fe640 1 -- 172.21.15.89:0/2824276212 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280402f850 con 0x7f28100b68d0 2023-08-25T09:42:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f280f7fe640 1 -- 172.21.15.89:0/2824276212 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280402f9b0 con 0x7f28100b68d0 2023-08-25T09:42:24.655 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f280f7fe640 1 -- 172.21.15.89:0/2824276212 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280402fd40 con 0x7f28100b68d0 2023-08-25T09:42:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 -- 172.21.15.89:0/2824276212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100b68d0 msgr2=0x7f281006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 --2- 172.21.15.89:0/2824276212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100b68d0 0x7f281006fd00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f281006be10 tx=0x7f280402ba30 comp rx=0 tx=0).stop 2023-08-25T09:42:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 -- 172.21.15.89:0/2824276212 shutdown_connections 2023-08-25T09:42:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 --2- 172.21.15.89:0/2824276212 >> v2:172.21.15.121:3300/0 conn(0x7f28100715a0 0x7f2810069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 --2- 172.21.15.89:0/2824276212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100b68d0 0x7f281006fd00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 -- 172.21.15.89:0/2824276212 >> 172.21.15.89:0/2824276212 conn(0x7f281006d350 msgr2=0x7f281006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 -- 172.21.15.89:0/2824276212 shutdown_connections 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.648+0000 7f2816d96640 1 -- 172.21.15.89:0/2824276212 wait complete. 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.649+0000 7f2816d96640 1 Processor -- start 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.649+0000 7f2816d96640 1 -- start start 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2816d96640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 0x7f28101d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2816d96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28100b68d0 0x7f2810141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2816d96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f281014a970 0x7f28101d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2816d96640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101d4800 con 0x7f28100715a0 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2816d96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101d21c0 con 0x7f28100b68d0 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2816d96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28101d18d0 con 0x7f281014a970 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 0x7f28101d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 0x7f28101d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36746/0 (socket says 172.21.15.89:36746) 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 -- 172.21.15.89:0/1293635644 learned_addr learned my addr 172.21.15.89:0/1293635644 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f280ffff640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28100b68d0 0x7f2810141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2815333640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f281014a970 0x7f28101d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 -- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f281014a970 msgr2=0x7f28101d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f281014a970 0x7f28101d42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 -- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28100b68d0 msgr2=0x7f2810141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28100b68d0 0x7f2810141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.650+0000 7f2814b32640 1 -- 172.21.15.89:0/1293635644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040094d0 con 0x7f28100715a0 2023-08-25T09:42:24.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.651+0000 7f2814b32640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 0x7f28101d2650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f280402ba70 tx=0x7f2804004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.651+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280402f840 con 0x7f28100715a0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.651+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804041400 con 0x7f28100715a0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.651+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2810145530 con 0x7f28100715a0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.651+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040417b0 con 0x7f28100715a0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.651+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28101d1e50 con 0x7f28100715a0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.652+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281004dc40 con 0x7f28100715a0 2023-08-25T09:42:24.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.652+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2804041910 con 0x7f28100715a0 2023-08-25T09:42:24.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.652+0000 7f280d7fa640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f27f406a050 0x7f27f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.653+0000 7f280ffff640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f27f406a050 0x7f27f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.653+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f280403c070 con 0x7f28100715a0 2023-08-25T09:42:24.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.653+0000 7f280ffff640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f27f406a050 0x7f27f406c510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f28101412e0 tx=0x7f27fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.657+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2804076cc0 con 0x7f28100715a0 2023-08-25T09:42:24.825 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.823+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2810144c60 con 0x7f28100715a0 2023-08-25T09:42:24.826 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.824+0000 7f280d7fa640 1 -- 172.21.15.89:0/1293635644 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f280407a2e0 con 0x7f28100715a0 2023-08-25T09:42:24.826 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:24.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f27f406a050 msgr2=0x7f27f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f27f406a050 0x7f27f406c510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f28101412e0 tx=0x7f27fc008040 comp rx=0 tx=0).stop 2023-08-25T09:42:24.828 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 msgr2=0x7f28101d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 0x7f28101d2650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f280402ba70 tx=0x7f2804004730 comp rx=0 tx=0).stop 2023-08-25T09:42:24.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 shutdown_connections 2023-08-25T09:42:24.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f27f406a050 0x7f27f406c510 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f281014a970 0x7f28101d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.829 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28100b68d0 0x7f2810141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.825+0000 7f2816d96640 1 --2- 172.21.15.89:0/1293635644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28100715a0 0x7f28101d2650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.826+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 >> 172.21.15.89:0/1293635644 conn(0x7f281006d350 msgr2=0x7f28100bbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.826+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 shutdown_connections 2023-08-25T09:42:24.830 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.826+0000 7f2816d96640 1 -- 172.21.15.89:0/1293635644 wait complete. 2023-08-25T09:42:24.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:24.940 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.938+0000 7f540665e640 1 Processor -- start 2023-08-25T09:42:24.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.938+0000 7f540665e640 1 -- start start 2023-08-25T09:42:24.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f540665e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54000b7b80 0x7f54000b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f540665e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54001415c0 0x7f5400141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f540665e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540006e880 con 0x7f5400070810 2023-08-25T09:42:24.941 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f540665e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000b3570 con 0x7f54000b7b80 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f540665e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000b3000 con 0x7f54001415c0 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54000b7b80 0x7f54000b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54000b7b80 0x7f54000b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36760/0 (socket says 172.21.15.89:36760) 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 -- 172.21.15.89:0/2391205436 learned_addr learned my addr 172.21.15.89:0/2391205436 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53ff7fe640 1 --2- 172.21.15.89:0/2391205436 >> v2:172.21.15.121:3300/0 conn(0x7f54001415c0 0x7f5400141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 -- 172.21.15.89:0/2391205436 >> v2:172.21.15.121:3300/0 conn(0x7f54001415c0 msgr2=0x7f5400141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:24.942 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 --2- 172.21.15.89:0/2391205436 >> v2:172.21.15.121:3300/0 conn(0x7f54001415c0 0x7f5400141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 -- 172.21.15.89:0/2391205436 >> v1:172.21.15.89:6789/0 conn(0x7f5400070810 legacy=0x7f5400069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53feffd640 1 -- 172.21.15.89:0/2391205436 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582908377 0 0) 0x7f540006e880 con 0x7f5400070810 2023-08-25T09:42:24.943 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.939+0000 7f53fffff640 1 -- 172.21.15.89:0/2391205436 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540014ab90 con 0x7f54000b7b80 2023-08-25T09:42:24.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f53fffff640 1 --2- 172.21.15.89:0/2391205436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54000b7b80 0x7f54000b27a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f54000b8540 tx=0x7f53f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b150b6d20ee511c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f53feffd640 1 -- 172.21.15.89:0/2391205436 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0031870 con 0x7f54000b7b80 2023-08-25T09:42:24.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f53feffd640 1 -- 172.21.15.89:0/2391205436 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f00319d0 con 0x7f54000b7b80 2023-08-25T09:42:24.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f53feffd640 1 -- 172.21.15.89:0/2391205436 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0031d60 con 0x7f54000b7b80 2023-08-25T09:42:24.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f540665e640 1 -- 172.21.15.89:0/2391205436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54000b7b80 msgr2=0x7f54000b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f540665e640 1 --2- 172.21.15.89:0/2391205436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54000b7b80 0x7f54000b27a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f54000b8540 tx=0x7f53f002b910 comp rx=0 tx=0).stop 2023-08-25T09:42:24.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f540665e640 1 -- 172.21.15.89:0/2391205436 shutdown_connections 2023-08-25T09:42:24.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f540665e640 1 --2- 172.21.15.89:0/2391205436 >> v2:172.21.15.121:3300/0 conn(0x7f54001415c0 0x7f5400141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f540665e640 1 --2- 172.21.15.89:0/2391205436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54000b7b80 0x7f54000b27a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.940+0000 7f540665e640 1 -- 172.21.15.89:0/2391205436 >> 172.21.15.89:0/2391205436 conn(0x7f54000bbe80 msgr2=0x7f54000bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:24.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.941+0000 7f540665e640 1 -- 172.21.15.89:0/2391205436 shutdown_connections 2023-08-25T09:42:24.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.941+0000 7f540665e640 1 -- 172.21.15.89:0/2391205436 wait complete. 2023-08-25T09:42:24.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.941+0000 7f540665e640 1 Processor -- start 2023-08-25T09:42:24.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 -- start start 2023-08-25T09:42:24.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5400070810 0x7f54000b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54000b7b80 0x7f5400138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 0x7f54001391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54000b6fb0 con 0x7f54001415c0 2023-08-25T09:42:24.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54001e15d0 con 0x7f54000b7b80 2023-08-25T09:42:24.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f540665e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5400142410 con 0x7f5400070810 2023-08-25T09:42:24.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f5404bfb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 0x7f54001391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f5404bfb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 0x7f54001391d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36768/0 (socket says 172.21.15.89:36768) 2023-08-25T09:42:24.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f5404bfb640 1 -- 172.21.15.89:0/841994551 learned_addr learned my addr 172.21.15.89:0/841994551 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f53ff7fe640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54000b7b80 0x7f5400138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.942+0000 7f53fffff640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5400070810 0x7f54000b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f5404bfb640 1 -- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5400070810 msgr2=0x7f54000b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f5404bfb640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5400070810 0x7f54000b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f5404bfb640 1 -- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54000b7b80 msgr2=0x7f5400138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f5404bfb640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54000b7b80 0x7f5400138c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f5404bfb640 1 -- 172.21.15.89:0/841994551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00094d0 con 0x7f54001415c0 2023-08-25T09:42:24.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f5404bfb640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 0x7f54001391d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53f8007fd0 tx=0x7f53f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8003b70 con 0x7f54001415c0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8003cf0 con 0x7f54001415c0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54001478d0 con 0x7f54001415c0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800aa60 con 0x7f54001415c0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.943+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54000bb450 con 0x7f54001415c0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.944+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54001e1780 con 0x7f54001415c0 2023-08-25T09:42:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.944+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f53f800abc0 con 0x7f54001415c0 2023-08-25T09:42:24.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.945+0000 7f53fcff9640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f53ec06a050 0x7f53ec06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:24.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.945+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53f8088340 con 0x7f54001415c0 2023-08-25T09:42:24.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.945+0000 7f53fffff640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f53ec06a050 0x7f53ec06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:24.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.945+0000 7f53fffff640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f53ec06a050 0x7f53ec06c510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f53f0036000 tx=0x7f53f003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:24.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:24.949+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f54001e1780 con 0x7f54001415c0 2023-08-25T09:42:25.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.113+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54001e1740 con 0x7f54001415c0 2023-08-25T09:42:25.115 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.114+0000 7f53fcff9640 1 -- 172.21.15.89:0/841994551 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53f8003e60 con 0x7f54001415c0 2023-08-25T09:42:25.116 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:25.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f53ec06a050 msgr2=0x7f53ec06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f53ec06a050 0x7f53ec06c510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f53f0036000 tx=0x7f53f003c040 comp rx=0 tx=0).stop 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 msgr2=0x7f54001391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 0x7f54001391d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53f8007fd0 tx=0x7f53f800cc70 comp rx=0 tx=0).stop 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 shutdown_connections 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f53ec06a050 0x7f53ec06c510 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54001415c0 0x7f54001391d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54000b7b80 0x7f5400138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 --2- 172.21.15.89:0/841994551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5400070810 0x7f54000b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 >> 172.21.15.89:0/841994551 conn(0x7f54000bbe80 msgr2=0x7f54000bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:25.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 shutdown_connections 2023-08-25T09:42:25.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.116+0000 7f540665e640 1 -- 172.21.15.89:0/841994551 wait complete. 2023-08-25T09:42:25.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:25.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.228+0000 7f13c6155640 1 Processor -- start 2023-08-25T09:42:25.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.228+0000 7f13c6155640 1 -- start start 2023-08-25T09:42:25.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13c6155640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c00bcf70 0x7f13c00bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.233 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13c6155640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00ba300 con 0x7f13c0144560 2023-08-25T09:42:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13c6155640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00bc8c0 con 0x7f13c014a9a0 2023-08-25T09:42:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13c6155640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00b9640 con 0x7f13c00bcf70 2023-08-25T09:42:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13beffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f13c0144560 0x7f13c0144980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37932/0 (socket says 172.21.15.89:37932) 2023-08-25T09:42:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13beffd640 1 -- 172.21.15.89:0/305734918 learned_addr learned my addr 172.21.15.89:0/305734918 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13bf7fe640 1 --2- 172.21.15.89:0/305734918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c00bcf70 0x7f13c00bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078062396 0 0) 0x7f13c00ba300 con 0x7f13c0144560 2023-08-25T09:42:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.229+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a8003520 con 0x7f13c0144560 2023-08-25T09:42:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325278944 0 0) 0x7f13c00bc8c0 con 0x7f13c014a9a0 2023-08-25T09:42:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c00ba300 con 0x7f13c014a9a0 2023-08-25T09:42:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13bf7fe640 1 -- 172.21.15.89:0/305734918 >> v1:172.21.15.121:6789/0 conn(0x7f13c014a9a0 legacy=0x7f13c014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585954530 0 0) 0x7f13a8003520 con 0x7f13c0144560 2023-08-25T09:42:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13bf7fe640 1 -- 172.21.15.89:0/305734918 >> v1:172.21.15.89:6789/0 conn(0x7f13c0144560 legacy=0x7f13c0144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13bf7fe640 1 -- 172.21.15.89:0/305734918 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00b8a60 con 0x7f13c00bcf70 2023-08-25T09:42:25.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.230+0000 7f13bf7fe640 1 --2- 172.21.15.89:0/305734918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c00bcf70 0x7f13c00bc380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097d0 tx=0x7f13b002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1885009125bcf95d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4001670 con 0x7f13c00bcf70 2023-08-25T09:42:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b002e050 con 0x7f13c00bcf70 2023-08-25T09:42:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13be7fc640 1 -- 172.21.15.89:0/305734918 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0030730 con 0x7f13c00bcf70 2023-08-25T09:42:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 -- 172.21.15.89:0/305734918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c00bcf70 msgr2=0x7f13c00bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 --2- 172.21.15.89:0/305734918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c00bcf70 0x7f13c00bc380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097d0 tx=0x7f13b002b800 comp rx=0 tx=0).stop 2023-08-25T09:42:25.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 -- 172.21.15.89:0/305734918 shutdown_connections 2023-08-25T09:42:25.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 --2- 172.21.15.89:0/305734918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c00bcf70 0x7f13c00bc380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 -- 172.21.15.89:0/305734918 >> 172.21.15.89:0/305734918 conn(0x7f13c00654f0 msgr2=0x7f13c00658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:25.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 -- 172.21.15.89:0/305734918 shutdown_connections 2023-08-25T09:42:25.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.231+0000 7f13c6155640 1 -- 172.21.15.89:0/305734918 wait complete. 2023-08-25T09:42:25.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.232+0000 7f13c6155640 1 Processor -- start 2023-08-25T09:42:25.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.232+0000 7f13c6155640 1 -- start start 2023-08-25T09:42:25.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13c6155640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c00bcf70 0x7f13c00be7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13c6155640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c0144560 0x7f13c01dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13c6155640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 0x7f13c01e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13c6155640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00bcb40 con 0x7f13c014a9a0 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13c6155640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c01df8f0 con 0x7f13c00bcf70 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13c6155640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00bed20 con 0x7f13c0144560 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 0x7f13c01e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 0x7f13c01e02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36776/0 (socket says 172.21.15.89:36776) 2023-08-25T09:42:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 -- 172.21.15.89:0/904550540 learned_addr learned my addr 172.21.15.89:0/904550540 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bf7fe640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c00bcf70 0x7f13c00be7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13beffd640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c0144560 0x7f13c01dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 -- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c0144560 msgr2=0x7f13c01dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c0144560 0x7f13c01dfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 -- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c00bcf70 msgr2=0x7f13c00be7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c00bcf70 0x7f13c00be7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 -- 172.21.15.89:0/904550540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009400 con 0x7f13c014a9a0 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bf7fe640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c00bcf70 0x7f13c00be7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.233+0000 7f13bffff640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 0x7f13c01e02c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c710 tx=0x7f13b800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.234+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8003b70 con 0x7f13c014a9a0 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.234+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b8003cd0 con 0x7f13c014a9a0 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.234+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b800aa50 con 0x7f13c014a9a0 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.234+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c0136a40 con 0x7f13c014a9a0 2023-08-25T09:42:25.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.234+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0137000 con 0x7f13c014a9a0 2023-08-25T09:42:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.235+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c01dfaa0 con 0x7f13c014a9a0 2023-08-25T09:42:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.235+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f13b800abb0 con 0x7f13c014a9a0 2023-08-25T09:42:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.235+0000 7f13a7fff640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f13ac06a050 0x7f13ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.235+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13b80883f0 con 0x7f13c014a9a0 2023-08-25T09:42:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.235+0000 7f13bf7fe640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f13ac06a050 0x7f13ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.236+0000 7f13bf7fe640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f13ac06a050 0x7f13ac06c510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13b0034000 tx=0x7f13b0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:25.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.239+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f13c01dfaa0 con 0x7f13c014a9a0 2023-08-25T09:42:25.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.410+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13c01dfaa0 con 0x7f13c014a9a0 2023-08-25T09:42:25.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.411+0000 7f13a7fff640 1 -- 172.21.15.89:0/904550540 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13c01dfaa0 con 0x7f13c014a9a0 2023-08-25T09:42:25.414 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:25.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f13ac06a050 msgr2=0x7f13ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f13ac06a050 0x7f13ac06c510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13b0034000 tx=0x7f13b0008030 comp rx=0 tx=0).stop 2023-08-25T09:42:25.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 msgr2=0x7f13c01e02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 0x7f13c01e02c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c710 tx=0x7f13b800cbd0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 shutdown_connections 2023-08-25T09:42:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f13ac06a050 0x7f13ac06c510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c014a9a0 0x7f13c01e02c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13c0144560 0x7f13c01dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 --2- 172.21.15.89:0/904550540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13c00bcf70 0x7f13c00be7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 >> 172.21.15.89:0/904550540 conn(0x7f13c00654f0 msgr2=0x7f13c0144980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:25.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 shutdown_connections 2023-08-25T09:42:25.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.413+0000 7f13c6155640 1 -- 172.21.15.89:0/904550540 wait complete. 2023-08-25T09:42:25.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-08-25T09:42:25.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dd526a640 1 Processor -- start 2023-08-25T09:42:25.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dd526a640 1 -- start start 2023-08-25T09:42:25.533 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dd526a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4dd01542b0 0x7f4dd01566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dd526a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd014e9f0 con 0x7f4dd0144c70 2023-08-25T09:42:25.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dd526a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd0145050 con 0x7f4dd006fda0 2023-08-25T09:42:25.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dd526a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd014ee80 con 0x7f4dd01542b0 2023-08-25T09:42:25.534 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dceffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4dd0144c70 0x7f4dd0069850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37946/0 (socket says 172.21.15.89:37946) 2023-08-25T09:42:25.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.523+0000 7f4dceffd640 1 -- 172.21.15.89:0/532176814 learned_addr learned my addr 172.21.15.89:0/532176814 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:25.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/532176814 >> v2:172.21.15.121:3300/0 conn(0x7f4dd01542b0 0x7f4dd01566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374044266 0 0) 0x7f4dd014e9f0 con 0x7f4dd0144c70 2023-08-25T09:42:25.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db8003520 con 0x7f4dd0144c70 2023-08-25T09:42:25.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1285305598 0 0) 0x7f4db8003520 con 0x7f4dd0144c70 2023-08-25T09:42:25.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 >> v2:172.21.15.121:3300/0 conn(0x7f4dd01542b0 msgr2=0x7f4dd01566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:25.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 --2- 172.21.15.89:0/532176814 >> v2:172.21.15.121:3300/0 conn(0x7f4dd01542b0 0x7f4dd01566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 >> v1:172.21.15.121:6789/0 conn(0x7f4dd006fda0 legacy=0x7f4dd014a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0069f60 con 0x7f4dd0144c70 2023-08-25T09:42:25.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f4dc4001670 con 0x7f4dd0144c70 2023-08-25T09:42:25.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 >> v1:172.21.15.89:6789/0 conn(0x7f4dd0144c70 legacy=0x7f4dd0069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8003970 0x7f4db8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4db80047c0 0x7f4db8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db8005180 0x7f4db800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd014ee80 con 0x7f4db8005180 2023-08-25T09:42:25.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db800c120 con 0x7f4db80047c0 2023-08-25T09:42:25.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db800c2e0 con 0x7f4db8003970 2023-08-25T09:42:25.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db8005180 0x7f4db800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dce7fc640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4db80047c0 0x7f4db8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dceffd640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8003970 0x7f4db8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 -- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8003970 msgr2=0x7f4db8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:25.541 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8003970 0x7f4db8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 -- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4db80047c0 msgr2=0x7f4db8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:25.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4db80047c0 0x7f4db8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.542 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dcf7fe640 1 -- 172.21.15.89:0/532176814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8003520 con 0x7f4db8005180 2023-08-25T09:42:25.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.524+0000 7f4dceffd640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8003970 0x7f4db8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:25.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.525+0000 7f4dcf7fe640 1 -- 172.21.15.89:0/532176814 reap_dead start 2023-08-25T09:42:25.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.525+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db8005180 0x7f4db800b980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009f90 tx=0x7f4db80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7fe3ba0481b847 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:25.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.525+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc802cc20 con 0x7f4db8005180 2023-08-25T09:42:25.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.525+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800f040 con 0x7f4db8005180 2023-08-25T09:42:25.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.525+0000 7f4dcdffb640 1 -- 172.21.15.89:0/532176814 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8034440 con 0x7f4db8005180 2023-08-25T09:42:25.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 -- 172.21.15.89:0/532176814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db8005180 msgr2=0x7f4db800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db8005180 0x7f4db800b980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009f90 tx=0x7f4db80057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 -- 172.21.15.89:0/532176814 shutdown_connections 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 --2- 172.21.15.89:0/532176814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db8005180 0x7f4db800b980 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 -- 172.21.15.89:0/532176814 >> 172.21.15.89:0/532176814 conn(0x7f4dd006d3d0 msgr2=0x7f4dd006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 -- 172.21.15.89:0/532176814 shutdown_connections 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.526+0000 7f4dd526a640 1 -- 172.21.15.89:0/532176814 wait complete. 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.527+0000 7f4dd526a640 1 Processor -- start 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.527+0000 7f4dd526a640 1 -- start start 2023-08-25T09:42:25.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.527+0000 7f4dd526a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8005180 0x7f4dd00b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.527+0000 7f4dd526a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 0x7f4dd01dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.527+0000 7f4dd526a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4dd01dff50 0x7f4dd013e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.527+0000 7f4dd526a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00b5240 con 0x7f4dd00b7070 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dd526a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00b6340 con 0x7f4dd01dff50 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dd526a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00b4fd0 con 0x7f4db8005180 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 0x7f4dd01dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 0x7f4dd01dfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36804/0 (socket says 172.21.15.89:36804) 2023-08-25T09:42:25.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 -- 172.21.15.89:0/1589954599 learned_addr learned my addr 172.21.15.89:0/1589954599 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:25.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4dd01dff50 0x7f4dd013e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dceffd640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8005180 0x7f4dd00b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 -- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8005180 msgr2=0x7f4dd00b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8005180 0x7f4dd00b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 -- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4dd01dff50 msgr2=0x7f4dd013e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4dd01dff50 0x7f4dd013e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 -- 172.21.15.89:0/1589954599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd01e03d0 con 0x7f4dd00b7070 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dcf7fe640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4dd01dff50 0x7f4dd013e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dceffd640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8005180 0x7f4dd00b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:25.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dce7fc640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 0x7f4dd01dfa10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000f650 tx=0x7f4dc000fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00050d0 con 0x7f4dd00b7070 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0005230 con 0x7f4dd00b7070 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000d730 con 0x7f4dd00b7070 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd00b4890 con 0x7f4dd00b7070 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.528+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd01408a0 con 0x7f4dd00b7070 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.529+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd00b46f0 con 0x7f4dd00b7070 2023-08-25T09:42:25.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.530+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4dc000d890 con 0x7f4dd00b7070 2023-08-25T09:42:25.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.530+0000 7f4db77fe640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4dbc06a050 0x7f4dbc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:25.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.530+0000 7f4dceffd640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4dbc06a050 0x7f4dbc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:25.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.530+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4dc00883a0 con 0x7f4dd00b7070 2023-08-25T09:42:25.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.530+0000 7f4dceffd640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4dbc06a050 0x7f4dbc06c510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4001200 tx=0x7f4dc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:25.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.534+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4dd00b46f0 con 0x7f4dd00b7070 2023-08-25T09:42:25.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:25.765+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f4dd00b46f0 con 0x7f4dd00b7070 2023-08-25T09:42:26.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.385+0000 7f4db77fe640 1 -- 172.21.15.89:0/1589954599 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v50) v1 ==== 166+0+0 (secure 0 0 0) 0x7f4dd00b46f0 con 0x7f4dd00b7070 2023-08-25T09:42:26.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4dbc06a050 msgr2=0x7f4dbc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4dbc06a050 0x7f4dbc06c510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4001200 tx=0x7f4dc4009040 comp rx=0 tx=0).stop 2023-08-25T09:42:26.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 msgr2=0x7f4dd01dfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 0x7f4dd01dfa10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000f650 tx=0x7f4dc000fb10 comp rx=0 tx=0).stop 2023-08-25T09:42:26.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 shutdown_connections 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4dbc06a050 0x7f4dbc06c510 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd00b7070 0x7f4dd01dfa10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4dd01dff50 0x7f4dd013e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 --2- 172.21.15.89:0/1589954599 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4db8005180 0x7f4dd00b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 >> 172.21.15.89:0/1589954599 conn(0x7f4dd006d3d0 msgr2=0x7f4dd014ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 shutdown_connections 2023-08-25T09:42:26.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.388+0000 7f4dd526a640 1 -- 172.21.15.89:0/1589954599 wait complete. 2023-08-25T09:42:26.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T09:42:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.509+0000 7f8817ee7640 1 Processor -- start 2023-08-25T09:42:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8817ee7640 1 -- start start 2023-08-25T09:42:26.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8817ee7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f881014c7b0 0x7f8810154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8817ee7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8810142fb0 con 0x7f8810142bd0 2023-08-25T09:42:26.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8817ee7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881006f0e0 con 0x7f881006d1f0 2023-08-25T09:42:26.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8817ee7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881006d650 con 0x7f881014c7b0 2023-08-25T09:42:26.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8815c83640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8810142bd0 0x7f881006dd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59872/0 (socket says 172.21.15.89:59872) 2023-08-25T09:42:26.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8815c83640 1 -- 172.21.15.89:0/3718061327 learned_addr learned my addr 172.21.15.89:0/3718061327 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.510+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9741641 0 0) 0x7f880c001110 con 0x7f8810142bd0 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc003520 con 0x7f8810142bd0 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 --2- 172.21.15.89:0/3718061327 >> v2:172.21.15.121:3300/0 conn(0x7f881014c7b0 0x7f8810154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937331969 0 0) 0x7f87fc003520 con 0x7f8810142bd0 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 >> v2:172.21.15.121:3300/0 conn(0x7f881014c7b0 msgr2=0x7f8810154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 --2- 172.21.15.89:0/3718061327 >> v2:172.21.15.121:3300/0 conn(0x7f881014c7b0 0x7f8810154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 >> v1:172.21.15.121:6789/0 conn(0x7f881006d1f0 legacy=0x7f881014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:26.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881006e410 con 0x7f8810142bd0 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f880c001800 con 0x7f8810142bd0 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 >> v1:172.21.15.89:6789/0 conn(0x7f8810142bd0 legacy=0x7f881006dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87fc003970 0x7f87fc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0047c0 0x7f87fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87fc005180 0x7f87fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881006d650 con 0x7f87fc005180 2023-08-25T09:42:26.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc00c090 con 0x7f87fc0047c0 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc00c250 con 0x7f87fc003970 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87fc005180 0x7f87fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8815482640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0047c0 0x7f87fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8815c83640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87fc003970 0x7f87fc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 -- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87fc003970 msgr2=0x7f87fc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87fc003970 0x7f87fc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 -- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0047c0 msgr2=0x7f87fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:26.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0047c0 0x7f87fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.511+0000 7f8816484640 1 -- 172.21.15.89:0/3718061327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc003520 con 0x7f87fc005180 2023-08-25T09:42:26.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.512+0000 7f8816484640 1 -- 172.21.15.89:0/3718061327 reap_dead start 2023-08-25T09:42:26.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.512+0000 7f8816484640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87fc005180 0x7f87fc00b980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8808007360 tx=0x7f87fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698b848c6729ea9f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:26.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.512+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880802ccf0 con 0x7f87fc005180 2023-08-25T09:42:26.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.512+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880802ce50 con 0x7f87fc005180 2023-08-25T09:42:26.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.512+0000 7f8814c81640 1 -- 172.21.15.89:0/3718061327 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808003bd0 con 0x7f87fc005180 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 -- 172.21.15.89:0/3718061327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87fc005180 msgr2=0x7f87fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87fc005180 0x7f87fc00b980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8808007360 tx=0x7f87fc0057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 -- 172.21.15.89:0/3718061327 shutdown_connections 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3718061327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87fc005180 0x7f87fc00b980 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 -- 172.21.15.89:0/3718061327 >> 172.21.15.89:0/3718061327 conn(0x7f88100babd0 msgr2=0x7f88100bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 -- 172.21.15.89:0/3718061327 shutdown_connections 2023-08-25T09:42:26.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.513+0000 7f8817ee7640 1 -- 172.21.15.89:0/3718061327 wait complete. 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 Processor -- start 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 -- start start 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc005180 0x7f8810141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88100bdc60 0x7f88100a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 0x7f88101383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88100a2ba0 con 0x7f88100bce40 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810141090 con 0x7f87fc005180 2023-08-25T09:42:26.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8817ee7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88101407f0 con 0x7f88100bdc60 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8816484640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 0x7f88101383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8816484640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 0x7f88101383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52636/0 (socket says 172.21.15.89:52636) 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.514+0000 7f8816484640 1 -- 172.21.15.89:0/3188946142 learned_addr learned my addr 172.21.15.89:0/3188946142 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8815c83640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc005180 0x7f8810141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8815482640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88100bdc60 0x7f88100a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8816484640 1 -- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88100bdc60 msgr2=0x7f88100a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8816484640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88100bdc60 0x7f88100a2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8816484640 1 -- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc005180 msgr2=0x7f8810141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8816484640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc005180 0x7f8810141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8816484640 1 -- 172.21.15.89:0/3188946142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810140ad0 con 0x7f88100bce40 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8815c83640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc005180 0x7f8810141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8816484640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 0x7f88101383e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f880802dfd0 tx=0x7f8808004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808039070 con 0x7f88100bce40 2023-08-25T09:42:26.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808003e30 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8810140db0 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88080044b0 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.515+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88100bd2c0 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.516+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881004dc40 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.517+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f880803d070 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.517+0000 7f88067fc640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f87f406a080 0x7f87f406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.517+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88080a9830 con 0x7f88100bce40 2023-08-25T09:42:26.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.517+0000 7f8815c83640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f87f406a080 0x7f87f406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:26.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.517+0000 7f8815c83640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f87f406a080 0x7f87f406c540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f880c001680 tx=0x7f880c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:26.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.521+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8808074fb0 con 0x7f88100bce40 2023-08-25T09:42:26.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.686+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f88101463c0 con 0x7f88100bce40 2023-08-25T09:42:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.690+0000 7f88067fc640 1 -- 172.21.15.89:0/3188946142 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8808044030 con 0x7f88100bce40 2023-08-25T09:42:26.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f87f406a080 msgr2=0x7f87f406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f87f406a080 0x7f87f406c540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f880c001680 tx=0x7f880c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:26.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 msgr2=0x7f88101383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:26.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 0x7f88101383e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f880802dfd0 tx=0x7f8808004ab0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 shutdown_connections 2023-08-25T09:42:26.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f87f406a080 0x7f87f406c540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88100bce40 0x7f88101383e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88100bdc60 0x7f88100a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 --2- 172.21.15.89:0/3188946142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc005180 0x7f8810141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:26.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 >> 172.21.15.89:0/3188946142 conn(0x7f88100babd0 msgr2=0x7f881013d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:26.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 shutdown_connections 2023-08-25T09:42:26.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:26.692+0000 7f8817ee7640 1 -- 172.21.15.89:0/3188946142 wait complete. 2023-08-25T09:42:26.704 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T09:42:26.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T09:42:26.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T09:42:26.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T09:42:27.020 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T09:42:27.021 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:42:27.021 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T09:42:27.070 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:42:27.071 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T09:42:27.170 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:42:27.170 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T09:42:27.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.322+0000 7f06684ba640 1 Processor -- start 2023-08-25T09:42:27.324 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.322+0000 7f06684ba640 1 -- start start 2023-08-25T09:42:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f06684ba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660070120 0x7f0660070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f06684ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06600b2e20 0x7f066006f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f06684ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0660070a40 con 0x7f0660146f60 2023-08-25T09:42:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f06684ba640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066006ec00 con 0x7f06600b2e20 2023-08-25T09:42:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f06684ba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066006f560 con 0x7f0660070120 2023-08-25T09:42:27.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06600b2e20 0x7f066006f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f06600b2e20 0x7f066006f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52648/0 (socket says 172.21.15.89:52648) 2023-08-25T09:42:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 -- 172.21.15.89:0/1750453693 learned_addr learned my addr 172.21.15.89:0/1750453693 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 -- 172.21.15.89:0/1750453693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660070120 msgr2=0x7f0660070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:27.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 --2- 172.21.15.89:0/1750453693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660070120 0x7f0660070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 -- 172.21.15.89:0/1750453693 >> v1:172.21.15.121:6789/0 conn(0x7f0660146f60 legacy=0x7f06601441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:27.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.323+0000 7f0666a57640 1 -- 172.21.15.89:0/1750453693 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600b3530 con 0x7f06600b2e20 2023-08-25T09:42:27.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.324+0000 7f0666a57640 1 --2- 172.21.15.89:0/1750453693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066006f020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f065800bb10 tx=0x7f065802e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63edbc038a283cf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.324+0000 7f0665254640 1 -- 172.21.15.89:0/1750453693 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065802ede0 con 0x7f06600b2e20 2023-08-25T09:42:27.329 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.324+0000 7f0665254640 1 -- 172.21.15.89:0/1750453693 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658036440 con 0x7f06600b2e20 2023-08-25T09:42:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.324+0000 7f0665254640 1 -- 172.21.15.89:0/1750453693 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580367d0 con 0x7f06600b2e20 2023-08-25T09:42:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 -- 172.21.15.89:0/1750453693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 msgr2=0x7f066006f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 --2- 172.21.15.89:0/1750453693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066006f020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f065800bb10 tx=0x7f065802e030 comp rx=0 tx=0).stop 2023-08-25T09:42:27.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 -- 172.21.15.89:0/1750453693 shutdown_connections 2023-08-25T09:42:27.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 --2- 172.21.15.89:0/1750453693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066006f020 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 --2- 172.21.15.89:0/1750453693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660070120 0x7f0660070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.331 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 -- 172.21.15.89:0/1750453693 >> 172.21.15.89:0/1750453693 conn(0x7f0660069a30 msgr2=0x7f0660069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 -- 172.21.15.89:0/1750453693 shutdown_connections 2023-08-25T09:42:27.332 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.325+0000 7f06684ba640 1 -- 172.21.15.89:0/1750453693 wait complete. 2023-08-25T09:42:27.336 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 Processor -- start 2023-08-25T09:42:27.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 -- start start 2023-08-25T09:42:27.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660070120 0x7f066013d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066013dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660146f60 0x7f06601cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600b4b70 con 0x7f06600b2e20 2023-08-25T09:42:27.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06601cd1a0 con 0x7f0660070120 2023-08-25T09:42:27.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.326+0000 7f06684ba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600b45b0 con 0x7f0660146f60 2023-08-25T09:42:27.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066013dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066013dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52654/0 (socket says 172.21.15.89:52654) 2023-08-25T09:42:27.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 -- 172.21.15.89:0/2524453221 learned_addr learned my addr 172.21.15.89:0/2524453221 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:27.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0666a57640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660146f60 0x7f06601cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0666256640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660070120 0x7f066013d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 -- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660146f60 msgr2=0x7f06601cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660146f60 0x7f06601cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 -- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660070120 msgr2=0x7f066013d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660070120 0x7f066013d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 -- 172.21.15.89:0/2524453221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065800b770 con 0x7f06600b2e20 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0666256640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660070120 0x7f066013d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0666a57640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660146f60 0x7f06601cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f0665a55640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066013dd20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f065400b3c0 tx=0x7f065400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.341 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011830 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654011990 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06600b4890 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011d40 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.327+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06600b5560 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.328+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06601ccf70 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.329+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f065401b460 con 0x7f06600b2e20 2023-08-25T09:42:27.342 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.329+0000 7f065effd640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f064c06a050 0x7f064c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.329+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0654088010 con 0x7f06600b2e20 2023-08-25T09:42:27.343 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.329+0000 7f0666256640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f064c06a050 0x7f064c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.329+0000 7f0666256640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f064c06a050 0x7f064c06c510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0650007eb0 tx=0x7f06500073c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.344 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.333+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06601ccf70 con 0x7f06600b2e20 2023-08-25T09:42:27.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.502+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06601ccf70 con 0x7f06600b2e20 2023-08-25T09:42:27.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.504+0000 7f065effd640 1 -- 172.21.15.89:0/2524453221 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f06601ccf70 con 0x7f06600b2e20 2023-08-25T09:42:27.505 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:27.506 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:27.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f064c06a050 msgr2=0x7f064c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f064c06a050 0x7f064c06c510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0650007eb0 tx=0x7f06500073c0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 msgr2=0x7f066013dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066013dd20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f065400b3c0 tx=0x7f065400b880 comp rx=0 tx=0).stop 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 shutdown_connections 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f064c06a050 0x7f064c06c510 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06600b2e20 0x7f066013dd20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0660146f60 0x7f06601cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 --2- 172.21.15.89:0/2524453221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660070120 0x7f066013d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 >> 172.21.15.89:0/2524453221 conn(0x7f0660069a30 msgr2=0x7f0660144e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:27.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 shutdown_connections 2023-08-25T09:42:27.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.506+0000 7f06684ba640 1 -- 172.21.15.89:0/2524453221 wait complete. 2023-08-25T09:42:27.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:27.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:27.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.620+0000 7f7d69e83640 1 Processor -- start 2023-08-25T09:42:27.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.620+0000 7f7d69e83640 1 -- start start 2023-08-25T09:42:27.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d69e83640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d64142a70 0x7f7d64070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d69e83640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b7c50 0x7f7d640b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d69e83640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640b27a0 con 0x7f7d640b3b20 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d69e83640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640b4150 con 0x7f7d64142a70 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d69e83640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640b2fb0 con 0x7f7d640b7c50 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d64142a70 0x7f7d64070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d64142a70 0x7f7d64070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52664/0 (socket says 172.21.15.89:52664) 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 -- 172.21.15.89:0/604156934 learned_addr learned my addr 172.21.15.89:0/604156934 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d63fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7d640b3b20 0x7f7d64069850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59876/0 (socket says 172.21.15.89:59876) 2023-08-25T09:42:27.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d62ffd640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b7c50 0x7f7d640b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 -- 172.21.15.89:0/604156934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b7c50 msgr2=0x7f7d640b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:27.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b7c50 0x7f7d640b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 -- 172.21.15.89:0/604156934 >> v1:172.21.15.89:6789/0 conn(0x7f7d640b3b20 legacy=0x7f7d64069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d637fe640 1 -- 172.21.15.89:0/604156934 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64142e50 con 0x7f7d64142a70 2023-08-25T09:42:27.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d627fc640 1 -- 172.21.15.89:0/604156934 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968240732 0 0) 0x7f7d640b27a0 con 0x7f7d640b3b20 2023-08-25T09:42:27.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.621+0000 7f7d62ffd640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b7c50 0x7f7d640b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:27.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.622+0000 7f7d637fe640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d64142a70 0x7f7d64070950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009870 tx=0x7f7d5402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adafaa79190ea96 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.622+0000 7f7d627fc640 1 -- 172.21.15.89:0/604156934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54030840 con 0x7f7d64142a70 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.622+0000 7f7d627fc640 1 -- 172.21.15.89:0/604156934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d540309a0 con 0x7f7d64142a70 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.622+0000 7f7d627fc640 1 -- 172.21.15.89:0/604156934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54030d30 con 0x7f7d64142a70 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 -- 172.21.15.89:0/604156934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d64142a70 msgr2=0x7f7d64070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d64142a70 0x7f7d64070950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009870 tx=0x7f7d5402b980 comp rx=0 tx=0).stop 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 -- 172.21.15.89:0/604156934 shutdown_connections 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b7c50 0x7f7d640b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 --2- 172.21.15.89:0/604156934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d64142a70 0x7f7d64070950 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 -- 172.21.15.89:0/604156934 >> 172.21.15.89:0/604156934 conn(0x7f7d640bbe80 msgr2=0x7f7d640bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 -- 172.21.15.89:0/604156934 shutdown_connections 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.623+0000 7f7d69e83640 1 -- 172.21.15.89:0/604156934 wait complete. 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 Processor -- start 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 -- start start 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b3b20 0x7f7d6413a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 0x7f7d640baf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d64142a70 0x7f7d641e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64145960 con 0x7f7d640b7c50 2023-08-25T09:42:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64143e00 con 0x7f7d64142a70 2023-08-25T09:42:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.624+0000 7f7d69e83640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641446a0 con 0x7f7d640b3b20 2023-08-25T09:42:27.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 0x7f7d640baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 0x7f7d640baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52670/0 (socket says 172.21.15.89:52670) 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 -- 172.21.15.89:0/1083657753 learned_addr learned my addr 172.21.15.89:0/1083657753 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d637fe640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b3b20 0x7f7d6413a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d63fff640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d64142a70 0x7f7d641e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 -- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b3b20 msgr2=0x7f7d6413a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b3b20 0x7f7d6413a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 -- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d64142a70 msgr2=0x7f7d641e0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d64142a70 0x7f7d641e0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 -- 172.21.15.89:0/1083657753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540094d0 con 0x7f7d640b7c50 2023-08-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d62ffd640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 0x7f7d640baf00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800e840 tx=0x7f7d5800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58004030 con 0x7f7d640b7c50 2023-08-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58004190 con 0x7f7d640b7c50 2023-08-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58004520 con 0x7f7d640b7c50 2023-08-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d64144b30 con 0x7f7d640b7c50 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.625+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d64144330 con 0x7f7d640b7c50 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.626+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6404dc40 con 0x7f7d640b7c50 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.626+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7d5800c6d0 con 0x7f7d640b7c50 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.627+0000 7f7d4bfff640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7d5006a050 0x7f7d5006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.627+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d580881e0 con 0x7f7d640b7c50 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.627+0000 7f7d637fe640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7d5006a050 0x7f7d5006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.627+0000 7f7d637fe640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7d5006a050 0x7f7d5006c510 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7d54036000 tx=0x7f7d5403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.631+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7d580573f0 con 0x7f7d640b7c50 2023-08-25T09:42:27.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.798+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d640b6de0 con 0x7f7d640b7c50 2023-08-25T09:42:27.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.798+0000 7f7d4bfff640 1 -- 172.21.15.89:0/1083657753 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d58056f80 con 0x7f7d640b7c50 2023-08-25T09:42:27.802 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:27.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7d5006a050 msgr2=0x7f7d5006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7d5006a050 0x7f7d5006c510 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7d54036000 tx=0x7f7d5403b040 comp rx=0 tx=0).stop 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 msgr2=0x7f7d640baf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 0x7f7d640baf00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800e840 tx=0x7f7d5800ed00 comp rx=0 tx=0).stop 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 shutdown_connections 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7d5006a050 0x7f7d5006c510 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d640b7c50 0x7f7d640baf00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d64142a70 0x7f7d641e0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 --2- 172.21.15.89:0/1083657753 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d640b3b20 0x7f7d6413a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 >> 172.21.15.89:0/1083657753 conn(0x7f7d640bbe80 msgr2=0x7f7d6413e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 shutdown_connections 2023-08-25T09:42:27.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.800+0000 7f7d69e83640 1 -- 172.21.15.89:0/1083657753 wait complete. 2023-08-25T09:42:27.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:27.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.913+0000 7f7d04034640 1 Processor -- start 2023-08-25T09:42:27.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.913+0000 7f7d04034640 1 -- start start 2023-08-25T09:42:27.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d04034640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7cfc0bad80 0x7f7cfc14c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d04034640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc148720 0x7f7cfc142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d04034640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc0b6cd0 con 0x7f7cfc0b4850 2023-08-25T09:42:27.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d04034640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc0b59c0 con 0x7f7cfc0bad80 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d04034640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0b5f40 con 0x7f7cfc148720 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d025d1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7cfc0b4850 0x7f7cfc0708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59888/0 (socket says 172.21.15.89:59888) 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d025d1640 1 -- 172.21.15.89:0/22987921 learned_addr learned my addr 172.21.15.89:0/22987921 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d015cf640 1 --2- 172.21.15.89:0/22987921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc148720 0x7f7cfc142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.914+0000 7f7d01dd0640 1 --2- 172.21.15.89:0/22987921 >> v2:172.21.15.121:3300/0 conn(0x7f7cfc0bad80 0x7f7cfc14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d00dce640 1 -- 172.21.15.89:0/22987921 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760736678 0 0) 0x7f7cfc0b6cd0 con 0x7f7cfc0b4850 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d00dce640 1 -- 172.21.15.89:0/22987921 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce8003520 con 0x7f7cfc0b4850 2023-08-25T09:42:27.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d015cf640 1 -- 172.21.15.89:0/22987921 >> v2:172.21.15.121:3300/0 conn(0x7f7cfc0bad80 msgr2=0x7f7cfc14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d015cf640 1 --2- 172.21.15.89:0/22987921 >> v2:172.21.15.121:3300/0 conn(0x7f7cfc0bad80 0x7f7cfc14c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d015cf640 1 -- 172.21.15.89:0/22987921 >> v1:172.21.15.89:6789/0 conn(0x7f7cfc0b4850 legacy=0x7f7cfc0708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d015cf640 1 -- 172.21.15.89:0/22987921 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0b5c60 con 0x7f7cfc148720 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.915+0000 7f7d01dd0640 1 --2- 172.21.15.89:0/22987921 >> v2:172.21.15.121:3300/0 conn(0x7f7cfc0bad80 0x7f7cfc14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d015cf640 1 --2- 172.21.15.89:0/22987921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc148720 0x7f7cfc142510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80097a0 tx=0x7f7cf802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef739a715f768110 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d00dce640 1 -- 172.21.15.89:0/22987921 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8031830 con 0x7f7cfc148720 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d00dce640 1 -- 172.21.15.89:0/22987921 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf8031990 con 0x7f7cfc148720 2023-08-25T09:42:27.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d00dce640 1 -- 172.21.15.89:0/22987921 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8031d00 con 0x7f7cfc148720 2023-08-25T09:42:27.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 -- 172.21.15.89:0/22987921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc148720 msgr2=0x7f7cfc142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 --2- 172.21.15.89:0/22987921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc148720 0x7f7cfc142510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80097a0 tx=0x7f7cf802b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 -- 172.21.15.89:0/22987921 shutdown_connections 2023-08-25T09:42:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 --2- 172.21.15.89:0/22987921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc148720 0x7f7cfc142510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 --2- 172.21.15.89:0/22987921 >> v2:172.21.15.121:3300/0 conn(0x7f7cfc0bad80 0x7f7cfc14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 -- 172.21.15.89:0/22987921 >> 172.21.15.89:0/22987921 conn(0x7f7cfc06e560 msgr2=0x7f7cfc06e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:27.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 -- 172.21.15.89:0/22987921 shutdown_connections 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.916+0000 7f7d04034640 1 -- 172.21.15.89:0/22987921 wait complete. 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.917+0000 7f7d04034640 1 Processor -- start 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.917+0000 7f7d04034640 1 -- start start 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d04034640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc0b4850 0x7f7cfc14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d04034640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cfc0bad80 0x7f7cfc1e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d04034640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 0x7f7cfc1df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d04034640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc14b400 con 0x7f7cfc148720 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d04034640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06c300 con 0x7f7cfc0bad80 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d04034640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06b170 con 0x7f7cfc0b4850 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 0x7f7cfc1df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 0x7f7cfc1df850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52684/0 (socket says 172.21.15.89:52684) 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 -- 172.21.15.89:0/4227140676 learned_addr learned my addr 172.21.15.89:0/4227140676 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d015cf640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cfc0bad80 0x7f7cfc1e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d01dd0640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc0b4850 0x7f7cfc14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 -- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc0b4850 msgr2=0x7f7cfc14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc0b4850 0x7f7cfc14aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 -- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cfc0bad80 msgr2=0x7f7cfc1e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cfc0bad80 0x7f7cfc1e2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d025d1640 1 -- 172.21.15.89:0/4227140676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec009400 con 0x7f7cfc148720 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.918+0000 7f7d01dd0640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc0b4850 0x7f7cfc14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.919+0000 7f7d025d1640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 0x7f7cfc1df850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400cbb0 tx=0x7f7cf400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.919+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400ace0 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.919+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400ae40 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.919+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf8009400 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.919+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4012600 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.919+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc0a7c40 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.920+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc04dc40 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.920+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7cf4012760 con 0x7f7cfc148720 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.920+0000 7f7cf27fc640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7ce006a080 0x7f7ce006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:27.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.920+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cf40883c0 con 0x7f7cfc148720 2023-08-25T09:42:27.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.921+0000 7f7d01dd0640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7ce006a080 0x7f7ce006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:27.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.921+0000 7f7d01dd0640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7ce006a080 0x7f7ce006c540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009c50 tx=0x7f7cec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:27.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:27.925+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7cf4053b70 con 0x7f7cfc148720 2023-08-25T09:42:28.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.089+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7cfc06b2b0 con 0x7f7cfc148720 2023-08-25T09:42:28.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.089+0000 7f7cf27fc640 1 -- 172.21.15.89:0/4227140676 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7cf4057190 con 0x7f7cfc148720 2023-08-25T09:42:28.092 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:28.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7ce006a080 msgr2=0x7f7ce006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7ce006a080 0x7f7ce006c540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009c50 tx=0x7f7cec008040 comp rx=0 tx=0).stop 2023-08-25T09:42:28.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 msgr2=0x7f7cfc1df850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 0x7f7cfc1df850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400cbb0 tx=0x7f7cf400a430 comp rx=0 tx=0).stop 2023-08-25T09:42:28.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 shutdown_connections 2023-08-25T09:42:28.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f7ce006a080 0x7f7ce006c540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cfc148720 0x7f7cfc1df850 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cfc0bad80 0x7f7cfc1e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 --2- 172.21.15.89:0/4227140676 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7cfc0b4850 0x7f7cfc14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 >> 172.21.15.89:0/4227140676 conn(0x7f7cfc06e560 msgr2=0x7f7cfc0b73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 shutdown_connections 2023-08-25T09:42:28.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.091+0000 7f7d04034640 1 -- 172.21.15.89:0/4227140676 wait complete. 2023-08-25T09:42:28.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:28.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.204+0000 7ff8e25e1640 1 Processor -- start 2023-08-25T09:42:28.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.204+0000 7ff8e25e1640 1 -- start start 2023-08-25T09:42:28.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8e25e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff8dc069ac0 0x7ff8dc0b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8e25e1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc06f850 con 0x7ff8dc14de70 2023-08-25T09:42:28.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8e25e1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0b8b90 con 0x7ff8dc0b9530 2023-08-25T09:42:28.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8e25e1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc071260 con 0x7ff8dc069ac0 2023-08-25T09:42:28.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8e0b7e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff8dc14de70 0x7ff8dc1551a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59900/0 (socket says 172.21.15.89:59900) 2023-08-25T09:42:28.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8e0b7e640 1 -- 172.21.15.89:0/827213559 learned_addr learned my addr 172.21.15.89:0/827213559 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:28.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8dbfff640 1 --2- 172.21.15.89:0/827213559 >> v2:172.21.15.121:3300/0 conn(0x7ff8dc069ac0 0x7ff8dc0b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612526236 0 0) 0x7ff8dc06f850 con 0x7ff8dc14de70 2023-08-25T09:42:28.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.205+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c4003520 con 0x7ff8dc14de70 2023-08-25T09:42:28.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849666299 0 0) 0x7ff8c4003520 con 0x7ff8dc14de70 2023-08-25T09:42:28.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 >> v2:172.21.15.121:3300/0 conn(0x7ff8dc069ac0 msgr2=0x7ff8dc0b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:28.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 --2- 172.21.15.89:0/827213559 >> v2:172.21.15.121:3300/0 conn(0x7ff8dc069ac0 0x7ff8dc0b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 >> v1:172.21.15.121:6789/0 conn(0x7ff8dc0b9530 legacy=0x7ff8dc14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc06faa0 con 0x7ff8dc14de70 2023-08-25T09:42:28.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7ff8d40019f0 con 0x7ff8dc14de70 2023-08-25T09:42:28.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 >> v1:172.21.15.89:6789/0 conn(0x7ff8dc14de70 legacy=0x7ff8dc1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8c4003970 0x7ff8c4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c4005180 0x7ff8c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc071260 con 0x7ff8c40047c0 2023-08-25T09:42:28.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c400c030 con 0x7ff8c4005180 2023-08-25T09:42:28.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c400c1f0 con 0x7ff8c4003970 2023-08-25T09:42:28.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8e0b7e640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c4005180 0x7ff8c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8dbfff640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8c4003970 0x7ff8c4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8db7fe640 1 -- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8c4003970 msgr2=0x7ff8c4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:28.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8c4003970 0x7ff8c4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8db7fe640 1 -- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c4005180 msgr2=0x7ff8c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:28.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c4005180 0x7ff8c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8db7fe640 1 -- 172.21.15.89:0/827213559 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4003520 con 0x7ff8c40047c0 2023-08-25T09:42:28.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8e0b7e640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c4005180 0x7ff8c400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:28.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.206+0000 7ff8e0b7e640 1 -- 172.21.15.89:0/827213559 reap_dead start 2023-08-25T09:42:28.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8c4004c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0001750 tx=0x7ff8c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd5afac64ab7229 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00052d0 con 0x7ff8c40047c0 2023-08-25T09:42:28.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d002e050 con 0x7ff8c40047c0 2023-08-25T09:42:28.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8daffd640 1 -- 172.21.15.89:0/827213559 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0003830 con 0x7ff8c40047c0 2023-08-25T09:42:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 -- 172.21.15.89:0/827213559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 msgr2=0x7ff8c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8c4004c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0001750 tx=0x7ff8c40057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 -- 172.21.15.89:0/827213559 shutdown_connections 2023-08-25T09:42:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/827213559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8c4004c40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 -- 172.21.15.89:0/827213559 >> 172.21.15.89:0/827213559 conn(0x7ff8dc06d350 msgr2=0x7ff8dc06d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 -- 172.21.15.89:0/827213559 shutdown_connections 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.207+0000 7ff8e25e1640 1 -- 172.21.15.89:0/827213559 wait complete. 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.208+0000 7ff8e25e1640 1 Processor -- start 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.208+0000 7ff8e25e1640 1 -- start start 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8e25e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8dc141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8e25e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8dc0bb060 0x7ff8dc1e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8e25e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8dc1e3a20 0x7ff8dc1dff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8e25e1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1421b0 con 0x7ff8c40047c0 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8e25e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1e2da0 con 0x7ff8dc0bb060 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8e25e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1dfab0 con 0x7ff8dc1e3a20 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8dc141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8dc141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52700/0 (socket says 172.21.15.89:52700) 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 -- 172.21.15.89:0/2135175388 learned_addr learned my addr 172.21.15.89:0/2135175388 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 -- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8dc1e3a20 msgr2=0x7ff8dc1dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8dc1e3a20 0x7ff8dc1dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 -- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8dc0bb060 msgr2=0x7ff8dc1e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8dc0bb060 0x7ff8dc1e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8dc0bb060 0x7ff8dc1e34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.209+0000 7ff8dbfff640 1 -- 172.21.15.89:0/2135175388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc141300 con 0x7ff8c40047c0 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.210+0000 7ff8dbfff640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8dc141c70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc011650 tx=0x7ff8cc011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.210+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00f960 con 0x7ff8c40047c0 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.210+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00fac0 con 0x7ff8c40047c0 2023-08-25T09:42:28.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.210+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc1415e0 con 0x7ff8c40047c0 2023-08-25T09:42:28.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.210+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00fe30 con 0x7ff8c40047c0 2023-08-25T09:42:28.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.210+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc13c540 con 0x7ff8c40047c0 2023-08-25T09:42:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.211+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc141820 con 0x7ff8c40047c0 2023-08-25T09:42:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.211+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff8cc015460 con 0x7ff8c40047c0 2023-08-25T09:42:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.211+0000 7ff8d8ff9640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff8c806a050 0x7ff8c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.211+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8cc088d50 con 0x7ff8c40047c0 2023-08-25T09:42:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.211+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff8c806a050 0x7ff8c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.212+0000 7ff8db7fe640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff8c806a050 0x7ff8c806c510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0033000 tx=0x7ff8d0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.215+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff8cc0544b0 con 0x7ff8c40047c0 2023-08-25T09:42:28.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.383+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8dc04dc40 con 0x7ff8c40047c0 2023-08-25T09:42:28.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.383+0000 7ff8d8ff9640 1 -- 172.21.15.89:0/2135175388 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8cc057ad0 con 0x7ff8c40047c0 2023-08-25T09:42:28.386 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:28.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff8c806a050 msgr2=0x7ff8c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff8c806a050 0x7ff8c806c510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0033000 tx=0x7ff8d0009030 comp rx=0 tx=0).stop 2023-08-25T09:42:28.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 msgr2=0x7ff8dc141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8dc141c70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc011650 tx=0x7ff8cc011b10 comp rx=0 tx=0).stop 2023-08-25T09:42:28.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 shutdown_connections 2023-08-25T09:42:28.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff8c806a050 0x7ff8c806c510 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8dc1e3a20 0x7ff8dc1dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8dc0bb060 0x7ff8dc1e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 --2- 172.21.15.89:0/2135175388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40047c0 0x7ff8dc141c70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 >> 172.21.15.89:0/2135175388 conn(0x7ff8dc06d350 msgr2=0x7ff8dc0bbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 shutdown_connections 2023-08-25T09:42:28.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.385+0000 7ff8e25e1640 1 -- 172.21.15.89:0/2135175388 wait complete. 2023-08-25T09:42:28.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:28.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.501+0000 7f01b57e8640 1 Processor -- start 2023-08-25T09:42:28.503 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.501+0000 7f01b57e8640 1 -- start start 2023-08-25T09:42:28.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01b57e8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 0x7f01b006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01b57e8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b014ee00 con 0x7f01b014b5e0 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01b57e8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b006c7f0 con 0x7f01b014b180 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01b57e8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b014aa70 con 0x7f01b006f180 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01af7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f01b014b5e0 0x7f01b014e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59912/0 (socket says 172.21.15.89:59912) 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01af7fe640 1 -- 172.21.15.89:0/2122767932 learned_addr learned my addr 172.21.15.89:0/2122767932 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01aeffd640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 0x7f01b006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.502+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563391902 0 0) 0x7f01b014ee00 con 0x7f01b014b5e0 2023-08-25T09:42:28.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0198003520 con 0x7f01b014b5e0 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880143397 0 0) 0x7f0198003520 con 0x7f01b014b5e0 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 msgr2=0x7f01b006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 0x7f01b006a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 >> v1:172.21.15.121:6789/0 conn(0x7f01b014b180 legacy=0x7f01b014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b006c230 con 0x7f01b014b5e0 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f01a8001670 con 0x7f01b014b5e0 2023-08-25T09:42:28.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 >> v1:172.21.15.89:6789/0 conn(0x7f01b014b5e0 legacy=0x7f01b014e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01980039a0 0x7f0198003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 0x7f01980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0198004d00 0x7f0198005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019800bac0 con 0x7f0198004d00 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019800bc00 con 0x7f01980039a0 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019800bdc0 con 0x7f01b006f180 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01af7fe640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0198004d00 0x7f0198005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01aeffd640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01980039a0 0x7f0198003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01ae7fc640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 0x7f01980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01af7fe640 1 -- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 msgr2=0x7f01980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01af7fe640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b006f180 0x7f01980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01af7fe640 1 -- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01980039a0 msgr2=0x7f0198003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01af7fe640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01980039a0 0x7f0198003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.503+0000 7f01af7fe640 1 -- 172.21.15.89:0/2122767932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198003520 con 0x7f0198004d00 2023-08-25T09:42:28.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01af7fe640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0198004d00 0x7f0198005180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f01a8001eb0 tx=0x7f01980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecdf03cc978107a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8005ad0 con 0x7f0198004d00 2023-08-25T09:42:28.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a8005c30 con 0x7f0198004d00 2023-08-25T09:42:28.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01adffb640 1 -- 172.21.15.89:0/2122767932 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a802c850 con 0x7f0198004d00 2023-08-25T09:42:28.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01b57e8640 1 -- 172.21.15.89:0/2122767932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0198004d00 msgr2=0x7f0198005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01b57e8640 1 --2- 172.21.15.89:0/2122767932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0198004d00 0x7f0198005180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f01a8001eb0 tx=0x7f01980057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01af7fe640 1 -- 172.21.15.89:0/2122767932 reap_dead start 2023-08-25T09:42:28.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01b57e8640 1 -- 172.21.15.89:0/2122767932 shutdown_connections 2023-08-25T09:42:28.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.504+0000 7f01b57e8640 1 -- 172.21.15.89:0/2122767932 >> 172.21.15.89:0/2122767932 conn(0x7f01b00babd0 msgr2=0x7f01b00bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.505+0000 7f01b57e8640 1 -- 172.21.15.89:0/2122767932 shutdown_connections 2023-08-25T09:42:28.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.505+0000 7f01b57e8640 1 -- 172.21.15.89:0/2122767932 wait complete. 2023-08-25T09:42:28.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 Processor -- start 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 -- start start 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b014a1c0 0x7f01b0145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 0x7f01b01dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b0146b40 0x7f01b014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01e0c20 con 0x7f01b00b7f00 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00a2960 con 0x7f01b014a1c0 2023-08-25T09:42:28.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01b57e8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b0147060 con 0x7f01b0146b40 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 0x7f01b01dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01ae7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 0x7f01b01dfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52720/0 (socket says 172.21.15.89:52720) 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.506+0000 7f01ae7fc640 1 -- 172.21.15.89:0/4064082405 learned_addr learned my addr 172.21.15.89:0/4064082405 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01aeffd640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b014a1c0 0x7f01b0145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01af7fe640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b0146b40 0x7f01b014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01ae7fc640 1 -- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b0146b40 msgr2=0x7f01b014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01ae7fc640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b0146b40 0x7f01b014df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01ae7fc640 1 -- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b014a1c0 msgr2=0x7f01b0145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01ae7fc640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b014a1c0 0x7f01b0145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01ae7fc640 1 -- 172.21.15.89:0/4064082405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b01454f0 con 0x7f01b00b7f00 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01ae7fc640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 0x7f01b01dfc60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01a400f820 tx=0x7f01a400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40050d0 con 0x7f01b00b7f00 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4005230 con 0x7f01b00b7f00 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400d730 con 0x7f01b00b7f00 2023-08-25T09:42:28.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b01457d0 con 0x7f01b00b7f00 2023-08-25T09:42:28.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.507+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b0147340 con 0x7f01b00b7f00 2023-08-25T09:42:28.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.508+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b006b070 con 0x7f01b00b7f00 2023-08-25T09:42:28.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.508+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f01a400d890 con 0x7f01b00b7f00 2023-08-25T09:42:28.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.509+0000 7f01977fe640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f019c06a050 0x7f019c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.509+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01a4088490 con 0x7f01b00b7f00 2023-08-25T09:42:28.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.509+0000 7f01aeffd640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f019c06a050 0x7f019c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.509+0000 7f01aeffd640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f019c06a050 0x7f019c06c510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007520 tx=0x7f01a000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.513+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f01a4053c10 con 0x7f01b00b7f00 2023-08-25T09:42:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.679+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01b004dc40 con 0x7f01b00b7f00 2023-08-25T09:42:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.680+0000 7f01977fe640 1 -- 172.21.15.89:0/4064082405 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01a4057230 con 0x7f01b00b7f00 2023-08-25T09:42:28.685 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f019c06a050 msgr2=0x7f019c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f019c06a050 0x7f019c06c510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007520 tx=0x7f01a000b040 comp rx=0 tx=0).stop 2023-08-25T09:42:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 msgr2=0x7f01b01dfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 0x7f01b01dfc60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01a400f820 tx=0x7f01a400fce0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 shutdown_connections 2023-08-25T09:42:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f019c06a050 0x7f019c06c510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01b00b7f00 0x7f01b01dfc60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01b0146b40 0x7f01b014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 --2- 172.21.15.89:0/4064082405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b014a1c0 0x7f01b0145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 >> 172.21.15.89:0/4064082405 conn(0x7f01b00babd0 msgr2=0x7f01b006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.681+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 shutdown_connections 2023-08-25T09:42:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.682+0000 7f01b57e8640 1 -- 172.21.15.89:0/4064082405 wait complete. 2023-08-25T09:42:28.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T09:42:28.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.793+0000 7f2b59dcf640 1 Processor -- start 2023-08-25T09:42:28.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.793+0000 7f2b59dcf640 1 -- start start 2023-08-25T09:42:28.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.793+0000 7f2b59dcf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b54070c00 0x7f2b54148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.793+0000 7f2b59dcf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540b30d0 con 0x7f2b540b39e0 2023-08-25T09:42:28.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.793+0000 7f2b59dcf640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540b2b10 con 0x7f2b540b7340 2023-08-25T09:42:28.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.793+0000 7f2b59dcf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b540b2df0 con 0x7f2b54070c00 2023-08-25T09:42:28.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b537fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b54070c00 0x7f2b54148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b537fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b54070c00 0x7f2b54148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52736/0 (socket says 172.21.15.89:52736) 2023-08-25T09:42:28.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b537fe640 1 -- 172.21.15.89:0/1811797199 learned_addr learned my addr 172.21.15.89:0/1811797199 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:28.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b53fff640 1 --1- 172.21.15.89:0/1811797199 >> v1:172.21.15.89:6789/0 conn(0x7f2b540b39e0 0x7f2b54153060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59916/0 (socket says 172.21.15.89:59916) 2023-08-25T09:42:28.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b537fe640 1 -- 172.21.15.89:0/1811797199 >> v1:172.21.15.121:6789/0 conn(0x7f2b540b7340 legacy=0x7f2b54142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b537fe640 1 -- 172.21.15.89:0/1811797199 >> v1:172.21.15.89:6789/0 conn(0x7f2b540b39e0 legacy=0x7f2b54153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b527fc640 1 -- 172.21.15.89:0/1811797199 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733042191 0 0) 0x7f2b540b30d0 con 0x7f2b540b39e0 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.794+0000 7f2b537fe640 1 -- 172.21.15.89:0/1811797199 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540b34c0 con 0x7f2b54070c00 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b537fe640 1 --2- 172.21.15.89:0/1811797199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b54070c00 0x7f2b54148810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b4402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f905e85004ccb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b527fc640 1 -- 172.21.15.89:0/1811797199 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44030860 con 0x7f2b54070c00 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b527fc640 1 -- 172.21.15.89:0/1811797199 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b440309c0 con 0x7f2b54070c00 2023-08-25T09:42:28.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b527fc640 1 -- 172.21.15.89:0/1811797199 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44030d50 con 0x7f2b54070c00 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 -- 172.21.15.89:0/1811797199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b54070c00 msgr2=0x7f2b54148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/1811797199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b54070c00 0x7f2b54148810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b4402b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 -- 172.21.15.89:0/1811797199 shutdown_connections 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/1811797199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b54070c00 0x7f2b54148810 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 -- 172.21.15.89:0/1811797199 >> 172.21.15.89:0/1811797199 conn(0x7f2b54069a30 msgr2=0x7f2b54069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 -- 172.21.15.89:0/1811797199 shutdown_connections 2023-08-25T09:42:28.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.795+0000 7f2b59dcf640 1 -- 172.21.15.89:0/1811797199 wait complete. 2023-08-25T09:42:28.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.796+0000 7f2b59dcf640 1 Processor -- start 2023-08-25T09:42:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.796+0000 7f2b59dcf640 1 -- start start 2023-08-25T09:42:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b59dcf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b54070c00 0x7f2b541e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b59dcf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 0x7f2b541d4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b59dcf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b540b7340 0x7f2b541d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b59dcf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b541d32f0 con 0x7f2b540b39e0 2023-08-25T09:42:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b59dcf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54146cd0 con 0x7f2b54070c00 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b59dcf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b541dfa90 con 0x7f2b540b7340 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 0x7f2b541d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 0x7f2b541d4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52738/0 (socket says 172.21.15.89:52738) 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 -- 172.21.15.89:0/3798515893 learned_addr learned my addr 172.21.15.89:0/3798515893 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 -- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b540b7340 msgr2=0x7f2b541d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b540b7340 0x7f2b541d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b537fe640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b54070c00 0x7f2b541e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 -- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b54070c00 msgr2=0x7f2b541e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b54070c00 0x7f2b541e01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b52ffd640 1 -- 172.21.15.89:0/3798515893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440094d0 con 0x7f2b540b39e0 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.797+0000 7f2b537fe640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b54070c00 0x7f2b541e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.798+0000 7f2b52ffd640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 0x7f2b541d4920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800c430 tx=0x7f2b4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.798+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b480052d0 con 0x7f2b540b39e0 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.798+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48005430 con 0x7f2b540b39e0 2023-08-25T09:42:28.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.798+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b541481e0 con 0x7f2b540b39e0 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.798+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48003830 con 0x7f2b540b39e0 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.798+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b54148710 con 0x7f2b540b39e0 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.799+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b54073bf0 con 0x7f2b540b39e0 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.799+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b48003990 con 0x7f2b540b39e0 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.800+0000 7f2b3bfff640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2b4006a050 0x7f2b4006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.800+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b48087b00 con 0x7f2b540b39e0 2023-08-25T09:42:28.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.800+0000 7f2b537fe640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2b4006a050 0x7f2b4006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:28.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.800+0000 7f2b537fe640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2b4006a050 0x7f2b4006c510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b44036000 tx=0x7f2b4403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:28.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.804+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2b480531f0 con 0x7f2b540b39e0 2023-08-25T09:42:28.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.985+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b5413ec50 con 0x7f2b540b39e0 2023-08-25T09:42:28.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.986+0000 7f2b3bfff640 1 -- 172.21.15.89:0/3798515893 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b48056810 con 0x7f2b540b39e0 2023-08-25T09:42:28.987 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2023-08-25T09:42:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2b4006a050 msgr2=0x7f2b4006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2b4006a050 0x7f2b4006c510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b44036000 tx=0x7f2b4403b040 comp rx=0 tx=0).stop 2023-08-25T09:42:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 msgr2=0x7f2b541d4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 0x7f2b541d4920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800c430 tx=0x7f2b4800c8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 shutdown_connections 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f2b4006a050 0x7f2b4006c510 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b540b39e0 0x7f2b541d4920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b540b7340 0x7f2b541d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 --2- 172.21.15.89:0/3798515893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b54070c00 0x7f2b541e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 >> 172.21.15.89:0/3798515893 conn(0x7f2b54069a30 msgr2=0x7f2b5413cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 shutdown_connections 2023-08-25T09:42:28.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:28.987+0000 7f2b59dcf640 1 -- 172.21.15.89:0/3798515893 wait complete. 2023-08-25T09:42:29.000 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T09:42:29.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:29.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-25T09:42:29.123 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-08-25T09:42:29.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:29.124 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T09:42:29.188 INFO:tasks.cephfs.cephfs_test_case:[] 2023-08-25T09:42:29.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:29.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.288+0000 7f254eebf640 1 Processor -- start 2023-08-25T09:42:29.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.288+0000 7f254eebf640 1 -- start start 2023-08-25T09:42:29.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254eebf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f254806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254eebf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f25480b9e70 0x7f2548155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254eebf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254814de90 con 0x7f25480b9a10 2023-08-25T09:42:29.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254eebf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254814ea80 con 0x7f25480b9e70 2023-08-25T09:42:29.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254eebf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b6e40 con 0x7f25480b6a60 2023-08-25T09:42:29.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f2547fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f25480b9a10 0x7f254814a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59932/0 (socket says 172.21.15.89:59932) 2023-08-25T09:42:29.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f2547fff640 1 -- 172.21.15.89:0/3374877135 learned_addr learned my addr 172.21.15.89:0/3374877135 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:29.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754049009 0 0) 0x7f254814de90 con 0x7f25480b9a10 2023-08-25T09:42:29.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f254806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2530003520 con 0x7f25480b9a10 2023-08-25T09:42:29.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f254d45c640 1 --2- 172.21.15.89:0/3374877135 >> v2:172.21.15.121:3300/0 conn(0x7f25480b9e70 0x7f2548155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2483891145 0 0) 0x7f2530003520 con 0x7f25480b9a10 2023-08-25T09:42:29.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 msgr2=0x7f254806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f254806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 >> v2:172.21.15.121:3300/0 conn(0x7f25480b9e70 msgr2=0x7f2548155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 --2- 172.21.15.89:0/3374877135 >> v2:172.21.15.121:3300/0 conn(0x7f25480b9e70 0x7f2548155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.289+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480702b0 con 0x7f25480b9a10 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f254806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f253c001670 con 0x7f25480b9a10 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 >> v1:172.21.15.89:6789/0 conn(0x7f25480b9a10 legacy=0x7f254814a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25300039e0 0x7f2530003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25300047c0 0x7f2530004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f2530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254814ea80 con 0x7f25300039e0 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b6e40 con 0x7f25300047c0 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253000ba60 con 0x7f25480b6a60 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254d45c640 1 --2- 172.21.15.89:0/3374877135 >> v2:172.21.15.121:3300/0 conn(0x7f25480b9e70 0x7f2548155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:29.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25300039e0 0x7f2530003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f2547fff640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25300047c0 0x7f2530004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254d45c640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f2530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 -- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 msgr2=0x7f2530005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25480b6a60 0x7f2530005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 -- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25300047c0 msgr2=0x7f2530004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25300047c0 0x7f2530004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.290+0000 7f254cc5b640 1 -- 172.21.15.89:0/3374877135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530003520 con 0x7f25300039e0 2023-08-25T09:42:29.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25300039e0 0x7f2530003e00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2538006fd0 tx=0x7f25300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b600f19d188657 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538004230 con 0x7f25300039e0 2023-08-25T09:42:29.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2538004390 con 0x7f25300039e0 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f25477fe640 1 -- 172.21.15.89:0/3374877135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538003830 con 0x7f25300039e0 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254eebf640 1 -- 172.21.15.89:0/3374877135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25300039e0 msgr2=0x7f2530003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254eebf640 1 --2- 172.21.15.89:0/3374877135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25300039e0 0x7f2530003e00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2538006fd0 tx=0x7f25300057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254d45c640 1 -- 172.21.15.89:0/3374877135 reap_dead start 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254eebf640 1 -- 172.21.15.89:0/3374877135 shutdown_connections 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254eebf640 1 -- 172.21.15.89:0/3374877135 >> 172.21.15.89:0/3374877135 conn(0x7f25480bcfa0 msgr2=0x7f25480bd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:29.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254eebf640 1 -- 172.21.15.89:0/3374877135 shutdown_connections 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.291+0000 7f254eebf640 1 -- 172.21.15.89:0/3374877135 wait complete. 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.292+0000 7f254eebf640 1 Processor -- start 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.292+0000 7f254eebf640 1 -- start start 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254eebf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25300039e0 0x7f25480ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254eebf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2548146c90 0x7f2548148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254eebf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 0x7f254814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254eebf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548147110 con 0x7f2548149fc0 2023-08-25T09:42:29.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254eebf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481e3920 con 0x7f2548146c90 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254eebf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25481e3c00 con 0x7f25300039e0 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254d45c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 0x7f254814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254d45c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 0x7f254814a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52758/0 (socket says 172.21.15.89:52758) 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254d45c640 1 -- 172.21.15.89:0/3636784352 learned_addr learned my addr 172.21.15.89:0/3636784352 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f2547fff640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2548146c90 0x7f2548148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.293+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25300039e0 0x7f25480ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.304 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254d45c640 1 -- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25300039e0 msgr2=0x7f25480ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254d45c640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25300039e0 0x7f25480ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254d45c640 1 -- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2548146c90 msgr2=0x7f2548148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254d45c640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2548146c90 0x7f2548148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254d45c640 1 -- 172.21.15.89:0/3636784352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25481e3ee0 con 0x7f2548149fc0 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254d45c640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 0x7f254814a470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f25480705e0 tx=0x7f2540007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540003ea0 con 0x7f2548149fc0 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000f050 con 0x7f2548149fc0 2023-08-25T09:42:29.305 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25481e41c0 con 0x7f2548149fc0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25400048a0 con 0x7f2548149fc0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.294+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25481e46e0 con 0x7f2548149fc0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.295+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25481e43e0 con 0x7f2548149fc0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.295+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2540014630 con 0x7f2548149fc0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.296+0000 7f25457fa640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f253406a080 0x7f253406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.296+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f253406a080 0x7f253406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.296+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25400888c0 con 0x7f2548149fc0 2023-08-25T09:42:29.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.296+0000 7f254cc5b640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f253406a080 0x7f253406c540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2538035000 tx=0x7f2538031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.307 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.300+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2540054060 con 0x7f2548149fc0 2023-08-25T09:42:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.505+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2548073bf0 con 0x7f2548149fc0 2023-08-25T09:42:29.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.505+0000 7f25457fa640 1 -- 172.21.15.89:0/3636784352 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7f2540057680 con 0x7f2548149fc0 2023-08-25T09:42:29.510 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:29.510 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:29.512 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f253406a080 msgr2=0x7f253406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f253406a080 0x7f253406c540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2538035000 tx=0x7f2538031000 comp rx=0 tx=0).stop 2023-08-25T09:42:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 msgr2=0x7f254814a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 0x7f254814a470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f25480705e0 tx=0x7f2540007700 comp rx=0 tx=0).stop 2023-08-25T09:42:29.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 shutdown_connections 2023-08-25T09:42:29.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f253406a080 0x7f253406c540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2548149fc0 0x7f254814a470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2548146c90 0x7f2548148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 --2- 172.21.15.89:0/3636784352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25300039e0 0x7f25480ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 >> 172.21.15.89:0/3636784352 conn(0x7f25480bcfa0 msgr2=0x7f25480b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:29.515 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 shutdown_connections 2023-08-25T09:42:29.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.507+0000 7f254eebf640 1 -- 172.21.15.89:0/3636784352 wait complete. 2023-08-25T09:42:29.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:29.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.617+0000 7f95e0e38640 1 Processor -- start 2023-08-25T09:42:29.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.617+0000 7f95e0e38640 1 -- start start 2023-08-25T09:42:29.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95e0e38640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95dc070120 0x7f95dc070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95e0e38640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95dc146f60 0x7f95dc06f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95e0e38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95e0e38640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc06ec00 con 0x7f95dc070120 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95e0e38640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc070a40 con 0x7f95dc146f60 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95e0e38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc06f560 con 0x7f95dc0b2e20 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95da59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95dc070120 0x7f95dc070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95da59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95dc070120 0x7f95dc070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52770/0 (socket says 172.21.15.89:52770) 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.618+0000 7f95da59c640 1 -- 172.21.15.89:0/1462364555 learned_addr learned my addr 172.21.15.89:0/1462364555 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95da59c640 1 -- 172.21.15.89:0/1462364555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 msgr2=0x7f95dc1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:29.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95d3fff640 1 --2- 172.21.15.89:0/1462364555 >> v2:172.21.15.121:3300/0 conn(0x7f95dc146f60 0x7f95dc06f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95da59c640 1 --2- 172.21.15.89:0/1462364555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95da59c640 1 -- 172.21.15.89:0/1462364555 >> v2:172.21.15.121:3300/0 conn(0x7f95dc146f60 msgr2=0x7f95dc06f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:29.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95da59c640 1 --2- 172.21.15.89:0/1462364555 >> v2:172.21.15.121:3300/0 conn(0x7f95dc146f60 0x7f95dc06f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95da59c640 1 -- 172.21.15.89:0/1462364555 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc0b3530 con 0x7f95dc070120 2023-08-25T09:42:29.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95da59c640 1 --2- 172.21.15.89:0/1462364555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc070500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0b6300 tx=0x7f95cc02de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e2ad499c330cdf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95d9d9b640 1 -- 172.21.15.89:0/1462364555 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc02ebc0 con 0x7f95dc070120 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95d9d9b640 1 -- 172.21.15.89:0/1462364555 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc032070 con 0x7f95dc070120 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.619+0000 7f95d9d9b640 1 -- 172.21.15.89:0/1462364555 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc038400 con 0x7f95dc070120 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 -- 172.21.15.89:0/1462364555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 msgr2=0x7f95dc070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 --2- 172.21.15.89:0/1462364555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc070500 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0b6300 tx=0x7f95cc02de10 comp rx=0 tx=0).stop 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 -- 172.21.15.89:0/1462364555 shutdown_connections 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 --2- 172.21.15.89:0/1462364555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 --2- 172.21.15.89:0/1462364555 >> v2:172.21.15.121:3300/0 conn(0x7f95dc146f60 0x7f95dc06f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 --2- 172.21.15.89:0/1462364555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc070500 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 -- 172.21.15.89:0/1462364555 >> 172.21.15.89:0/1462364555 conn(0x7f95dc069a30 msgr2=0x7f95dc069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 -- 172.21.15.89:0/1462364555 shutdown_connections 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.620+0000 7f95e0e38640 1 -- 172.21.15.89:0/1462364555 wait complete. 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.621+0000 7f95e0e38640 1 Processor -- start 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.621+0000 7f95e0e38640 1 -- start start 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95e0e38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc13dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95e0e38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95e0e38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95dc146f60 0x7f95dc1d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95e0e38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc13cd10 con 0x7f95dc070120 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95e0e38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc13cff0 con 0x7f95dc146f60 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95e0e38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc13d2d0 con 0x7f95dc0b2e20 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc13dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc13dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52772/0 (socket says 172.21.15.89:52772) 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 -- 172.21.15.89:0/3431861127 learned_addr learned my addr 172.21.15.89:0/3431861127 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:29.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95d3fff640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95dad9d640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95dc146f60 0x7f95dc1d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 -- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 msgr2=0x7f95dc1d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 -- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95dc146f60 msgr2=0x7f95dc1d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95dc146f60 0x7f95dc1d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 -- 172.21.15.89:0/3431861127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc00b760 con 0x7f95dc070120 2023-08-25T09:42:29.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95da59c640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc13dd20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.622+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc043440 con 0x7f95dc070120 2023-08-25T09:42:29.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.623+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0435c0 con 0x7f95dc070120 2023-08-25T09:42:29.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.623+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc13d5b0 con 0x7f95dc070120 2023-08-25T09:42:29.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.623+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc043970 con 0x7f95dc070120 2023-08-25T09:42:29.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.623+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc13eb60 con 0x7f95dc070120 2023-08-25T09:42:29.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.624+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95dc073bf0 con 0x7f95dc070120 2023-08-25T09:42:29.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.624+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95cc043ad0 con 0x7f95dc070120 2023-08-25T09:42:29.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.624+0000 7f95d2ffd640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f95bc06a050 0x7f95bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.624+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95cc0ad0d0 con 0x7f95dc070120 2023-08-25T09:42:29.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.624+0000 7f95d3fff640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f95bc06a050 0x7f95bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.625+0000 7f95d3fff640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f95bc06a050 0x7f95bc06c510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c4006fd0 tx=0x7f95c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.628+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f95cc0787b0 con 0x7f95dc070120 2023-08-25T09:42:29.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.795+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95dc13ce50 con 0x7f95dc070120 2023-08-25T09:42:29.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.796+0000 7f95d2ffd640 1 -- 172.21.15.89:0/3431861127 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f95dc13ce50 con 0x7f95dc070120 2023-08-25T09:42:29.798 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:29.798 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:29.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f95bc06a050 msgr2=0x7f95bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f95bc06a050 0x7f95bc06c510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c4006fd0 tx=0x7f95c4008040 comp rx=0 tx=0).stop 2023-08-25T09:42:29.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 msgr2=0x7f95dc13dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc13dd20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc0046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 shutdown_connections 2023-08-25T09:42:29.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f95bc06a050 0x7f95bc06c510 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95dc146f60 0x7f95dc1d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95dc0b2e20 0x7f95dc1d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 --2- 172.21.15.89:0/3431861127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95dc070120 0x7f95dc13dd20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 >> 172.21.15.89:0/3431861127 conn(0x7f95dc069a30 msgr2=0x7f95dc069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:29.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 shutdown_connections 2023-08-25T09:42:29.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.798+0000 7f95e0e38640 1 -- 172.21.15.89:0/3431861127 wait complete. 2023-08-25T09:42:29.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:41:58.960870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:41:59.553666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:29.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.914+0000 7f1559e8e640 1 Processor -- start 2023-08-25T09:42:29.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.914+0000 7f1559e8e640 1 -- start start 2023-08-25T09:42:29.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1559e8e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f155414a9a0 0x7f155414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1559e8e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15540ba300 con 0x7f1554144560 2023-08-25T09:42:29.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1559e8e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155414b350 con 0x7f15540bcf70 2023-08-25T09:42:29.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1559e8e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540b9640 con 0x7f155414a9a0 2023-08-25T09:42:29.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1552ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1554144560 0x7f15541449b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59936/0 (socket says 172.21.15.89:59936) 2023-08-25T09:42:29.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1552ffd640 1 -- 172.21.15.89:0/637275484 learned_addr learned my addr 172.21.15.89:0/637275484 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f1553fff640 1 --2- 172.21.15.89:0/637275484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f155414a9a0 0x7f155414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.915+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137772698 0 0) 0x7f15540ba300 con 0x7f1554144560 2023-08-25T09:42:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c003520 con 0x7f1554144560 2023-08-25T09:42:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841314732 0 0) 0x7f155414b350 con 0x7f15540bcf70 2023-08-25T09:42:29.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15540ba300 con 0x7f15540bcf70 2023-08-25T09:42:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f1553fff640 1 -- 172.21.15.89:0/637275484 >> v1:172.21.15.121:6789/0 conn(0x7f15540bcf70 legacy=0x7f15540bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f1553fff640 1 -- 172.21.15.89:0/637275484 >> v1:172.21.15.89:6789/0 conn(0x7f1554144560 legacy=0x7f15541449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f1553fff640 1 -- 172.21.15.89:0/637275484 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540b8a60 con 0x7f155414a9a0 2023-08-25T09:42:29.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.916+0000 7f1553fff640 1 --2- 172.21.15.89:0/637275484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f155414a9a0 0x7f155414ae10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f154c009dc0 tx=0x7f154c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07a17ec7d8cb8ab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c02ccd0 con 0x7f155414a9a0 2023-08-25T09:42:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c02ce30 con 0x7f155414a9a0 2023-08-25T09:42:29.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f15527fc640 1 -- 172.21.15.89:0/637275484 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c034660 con 0x7f155414a9a0 2023-08-25T09:42:29.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 -- 172.21.15.89:0/637275484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f155414a9a0 msgr2=0x7f155414ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 --2- 172.21.15.89:0/637275484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f155414a9a0 0x7f155414ae10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f154c009dc0 tx=0x7f154c02bf20 comp rx=0 tx=0).stop 2023-08-25T09:42:29.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 -- 172.21.15.89:0/637275484 shutdown_connections 2023-08-25T09:42:29.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 --2- 172.21.15.89:0/637275484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f155414a9a0 0x7f155414ae10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 -- 172.21.15.89:0/637275484 >> 172.21.15.89:0/637275484 conn(0x7f15540654f0 msgr2=0x7f15540658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 -- 172.21.15.89:0/637275484 shutdown_connections 2023-08-25T09:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.917+0000 7f1559e8e640 1 -- 172.21.15.89:0/637275484 wait complete. 2023-08-25T09:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.918+0000 7f1559e8e640 1 Processor -- start 2023-08-25T09:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.918+0000 7f1559e8e640 1 -- start start 2023-08-25T09:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1559e8e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15540bcf70 0x7f155414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1559e8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 0x7f15540b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1559e8e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155414a9a0 0x7f15540b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1559e8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540bcb40 con 0x7f1554144560 2023-08-25T09:42:29.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1559e8e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1554147770 con 0x7f155414a9a0 2023-08-25T09:42:29.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1559e8e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155414d4a0 con 0x7f15540bcf70 2023-08-25T09:42:29.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 0x7f15540b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 0x7f15540b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52784/0 (socket says 172.21.15.89:52784) 2023-08-25T09:42:29.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 -- 172.21.15.89:0/4039811471 learned_addr learned my addr 172.21.15.89:0/4039811471 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:29.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1553fff640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155414a9a0 0x7f15540b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f15537fe640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15540bcf70 0x7f155414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 -- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15540bcf70 msgr2=0x7f155414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15540bcf70 0x7f155414bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 -- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155414a9a0 msgr2=0x7f15540b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:29.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155414a9a0 0x7f15540b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:29.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1552ffd640 1 -- 172.21.15.89:0/4039811471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c009a70 con 0x7f1554144560 2023-08-25T09:42:29.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.919+0000 7f1553fff640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155414a9a0 0x7f15540b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:29.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.920+0000 7f1552ffd640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 0x7f15540b2e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1548001eb0 tx=0x7f154800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.920+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548005ce0 con 0x7f1554144560 2023-08-25T09:42:29.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.920+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1548005e40 con 0x7f1554144560 2023-08-25T09:42:29.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.920+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15541df980 con 0x7f1554144560 2023-08-25T09:42:29.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.920+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548007270 con 0x7f1554144560 2023-08-25T09:42:29.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.920+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1554147970 con 0x7f1554144560 2023-08-25T09:42:29.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.921+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155404dc40 con 0x7f1554144560 2023-08-25T09:42:29.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.921+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15480073d0 con 0x7f1554144560 2023-08-25T09:42:29.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.922+0000 7f153bfff640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f154006a050 0x7f154006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:29.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.922+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1548087aa0 con 0x7f1554144560 2023-08-25T09:42:29.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.922+0000 7f15537fe640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f154006a050 0x7f154006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:29.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.922+0000 7f15537fe640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f154006a050 0x7f154006c510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15440010e0 tx=0x7f1544009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:29.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:29.926+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1548056ce0 con 0x7f1554144560 2023-08-25T09:42:30.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.091+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15540b9fb0 con 0x7f1554144560 2023-08-25T09:42:30.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.092+0000 7f153bfff640 1 -- 172.21.15.89:0/4039811471 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1548056870 con 0x7f1554144560 2023-08-25T09:42:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:30.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f154006a050 msgr2=0x7f154006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f154006a050 0x7f154006c510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15440010e0 tx=0x7f1544009040 comp rx=0 tx=0).stop 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 msgr2=0x7f15540b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 0x7f15540b2e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1548001eb0 tx=0x7f154800c960 comp rx=0 tx=0).stop 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 shutdown_connections 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f154006a050 0x7f154006c510 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1554144560 0x7f15540b2e80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155414a9a0 0x7f15540b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 --2- 172.21.15.89:0/4039811471 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15540bcf70 0x7f155414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 >> 172.21.15.89:0/4039811471 conn(0x7f15540654f0 msgr2=0x7f15540be160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:30.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 shutdown_connections 2023-08-25T09:42:30.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.094+0000 7f1559e8e640 1 -- 172.21.15.89:0/4039811471 wait complete. 2023-08-25T09:42:30.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:30.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.206+0000 7f6b3758b640 1 Processor -- start 2023-08-25T09:42:30.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.206+0000 7f6b3758b640 1 -- start start 2023-08-25T09:42:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b3758b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6b30070f20 0x7f6b30141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b3758b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3006e880 con 0x7f6b301415c0 2023-08-25T09:42:30.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b3758b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3014ab90 con 0x7f6b300b7b80 2023-08-25T09:42:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b3758b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b300b3570 con 0x7f6b30070f20 2023-08-25T09:42:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b35b28640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6b30070f20 0x7f6b30141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b34b26640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6b301415c0 0x7f6b30070810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59948/0 (socket says 172.21.15.89:59948) 2023-08-25T09:42:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b34b26640 1 -- 172.21.15.89:0/2400295959 learned_addr learned my addr 172.21.15.89:0/2400295959 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:30.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b35b28640 1 -- 172.21.15.89:0/2400295959 >> v1:172.21.15.121:6789/0 conn(0x7f6b300b7b80 legacy=0x7f6b300b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b35b28640 1 -- 172.21.15.89:0/2400295959 >> v1:172.21.15.89:6789/0 conn(0x7f6b301415c0 legacy=0x7f6b30070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b35b28640 1 -- 172.21.15.89:0/2400295959 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300b3000 con 0x7f6b30070f20 2023-08-25T09:42:30.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.207+0000 7f6b27fff640 1 -- 172.21.15.89:0/2400295959 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012532910 0 0) 0x7f6b3006e880 con 0x7f6b301415c0 2023-08-25T09:42:30.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.208+0000 7f6b35b28640 1 --2- 172.21.15.89:0/2400295959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b30070f20 0x7f6b30141a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6b280097a0 tx=0x7f6b2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befa44b7c584d646 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.208+0000 7f6b27fff640 1 -- 172.21.15.89:0/2400295959 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28031830 con 0x7f6b30070f20 2023-08-25T09:42:30.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.208+0000 7f6b27fff640 1 -- 172.21.15.89:0/2400295959 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b28031990 con 0x7f6b30070f20 2023-08-25T09:42:30.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.208+0000 7f6b27fff640 1 -- 172.21.15.89:0/2400295959 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28031d20 con 0x7f6b30070f20 2023-08-25T09:42:30.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 -- 172.21.15.89:0/2400295959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b30070f20 msgr2=0x7f6b30141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 --2- 172.21.15.89:0/2400295959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b30070f20 0x7f6b30141a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6b280097a0 tx=0x7f6b2802b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 -- 172.21.15.89:0/2400295959 shutdown_connections 2023-08-25T09:42:30.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 --2- 172.21.15.89:0/2400295959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b30070f20 0x7f6b30141a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 -- 172.21.15.89:0/2400295959 >> 172.21.15.89:0/2400295959 conn(0x7f6b300bbe80 msgr2=0x7f6b300bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:30.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 -- 172.21.15.89:0/2400295959 shutdown_connections 2023-08-25T09:42:30.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.209+0000 7f6b3758b640 1 -- 172.21.15.89:0/2400295959 wait complete. 2023-08-25T09:42:30.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 Processor -- start 2023-08-25T09:42:30.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 -- start start 2023-08-25T09:42:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 0x7f6b3013b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b301415c0 0x7f6b300b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b300b7400 0x7f6b301e1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3013b760 con 0x7f6b300b7b80 2023-08-25T09:42:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301e0ed0 con 0x7f6b301415c0 2023-08-25T09:42:30.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b3758b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3014a8e0 con 0x7f6b300b7400 2023-08-25T09:42:30.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b35327640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 0x7f6b3013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b35327640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 0x7f6b3013b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52806/0 (socket says 172.21.15.89:52806) 2023-08-25T09:42:30.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.210+0000 7f6b35327640 1 -- 172.21.15.89:0/374508286 learned_addr learned my addr 172.21.15.89:0/374508286 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:30.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b34b26640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b301415c0 0x7f6b300b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b35327640 1 -- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b300b7400 msgr2=0x7f6b301e1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b35327640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b300b7400 0x7f6b301e1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b35327640 1 -- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b301415c0 msgr2=0x7f6b300b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b35327640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b301415c0 0x7f6b300b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b35327640 1 -- 172.21.15.89:0/374508286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28009400 con 0x7f6b300b7b80 2023-08-25T09:42:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b35327640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 0x7f6b3013b220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c8a0 tx=0x7f6b2c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c003b70 con 0x7f6b300b7b80 2023-08-25T09:42:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c003cf0 con 0x7f6b300b7b80 2023-08-25T09:42:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c00aa90 con 0x7f6b300b7b80 2023-08-25T09:42:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.211+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b30149250 con 0x7f6b300b7b80 2023-08-25T09:42:30.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.212+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b301497d0 con 0x7f6b300b7b80 2023-08-25T09:42:30.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.212+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3004dc40 con 0x7f6b300b7b80 2023-08-25T09:42:30.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.213+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b2c00abf0 con 0x7f6b300b7b80 2023-08-25T09:42:30.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.213+0000 7f6b25ffb640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6b1406a050 0x7f6b1406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.213+0000 7f6b34b26640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6b1406a050 0x7f6b1406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.213+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b2c088410 con 0x7f6b300b7b80 2023-08-25T09:42:30.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.214+0000 7f6b34b26640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6b1406a050 0x7f6b1406c510 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b300b2a50 tx=0x7f6b20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.225 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.217+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6b2c053bb0 con 0x7f6b300b7b80 2023-08-25T09:42:30.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:30.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:30.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.387+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b30140e50 con 0x7f6b300b7b80 2023-08-25T09:42:30.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.387+0000 7f6b25ffb640 1 -- 172.21.15.89:0/374508286 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b2c003e60 con 0x7f6b300b7b80 2023-08-25T09:42:30.389 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6b1406a050 msgr2=0x7f6b1406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6b1406a050 0x7f6b1406c510 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b300b2a50 tx=0x7f6b20009040 comp rx=0 tx=0).stop 2023-08-25T09:42:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 msgr2=0x7f6b3013b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 0x7f6b3013b220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c8a0 tx=0x7f6b2c00cd60 comp rx=0 tx=0).stop 2023-08-25T09:42:30.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 shutdown_connections 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6b1406a050 0x7f6b1406c510 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b300b7400 0x7f6b301e1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b301415c0 0x7f6b300b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 --2- 172.21.15.89:0/374508286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b300b7b80 0x7f6b3013b220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 >> 172.21.15.89:0/374508286 conn(0x7f6b300bbe80 msgr2=0x7f6b3013d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 shutdown_connections 2023-08-25T09:42:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.389+0000 7f6b3758b640 1 -- 172.21.15.89:0/374508286 wait complete. 2023-08-25T09:42:30.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T09:42:30.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.543+0000 7f87594bf640 1 Processor -- start 2023-08-25T09:42:30.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.543+0000 7f87594bf640 1 -- start start 2023-08-25T09:42:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87594bf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8754142bd0 0x7f875406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87594bf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f875406dd00 0x7f875414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87594bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f875406e160 0x7f875414c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87594bf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8754142fb0 con 0x7f875406dd00 2023-08-25T09:42:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87594bf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875406f0e0 con 0x7f8754142bd0 2023-08-25T09:42:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87594bf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875406e840 con 0x7f875406e160 2023-08-25T09:42:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f875406dd00 0x7f875414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f875406dd00 0x7f875414c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52822/0 (socket says 172.21.15.89:52822) 2023-08-25T09:42:30.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 -- 172.21.15.89:0/1808944275 learned_addr learned my addr 172.21.15.89:0/1808944275 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:30.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 -- 172.21.15.89:0/1808944275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f875406e160 msgr2=0x7f875414c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:30.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 --2- 172.21.15.89:0/1808944275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f875406e160 0x7f875414c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 -- 172.21.15.89:0/1808944275 >> v2:172.21.15.121:3300/0 conn(0x7f8754142bd0 msgr2=0x7f875406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:30.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 --2- 172.21.15.89:0/1808944275 >> v2:172.21.15.121:3300/0 conn(0x7f8754142bd0 0x7f875406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.544+0000 7f87527fc640 1 -- 172.21.15.89:0/1808944275 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875406eb20 con 0x7f875406dd00 2023-08-25T09:42:30.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.545+0000 7f87527fc640 1 --2- 172.21.15.89:0/1808944275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406dd00 0x7f875414c0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8754071cf0 tx=0x7f873c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e29e1294653c380 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.545+0000 7f8751ffb640 1 -- 172.21.15.89:0/1808944275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c030860 con 0x7f875406dd00 2023-08-25T09:42:30.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.545+0000 7f8751ffb640 1 -- 172.21.15.89:0/1808944275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c0309c0 con 0x7f875406dd00 2023-08-25T09:42:30.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.545+0000 7f8751ffb640 1 -- 172.21.15.89:0/1808944275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c030d50 con 0x7f875406dd00 2023-08-25T09:42:30.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 -- 172.21.15.89:0/1808944275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406dd00 msgr2=0x7f875414c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 --2- 172.21.15.89:0/1808944275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406dd00 0x7f875414c0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8754071cf0 tx=0x7f873c02b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 -- 172.21.15.89:0/1808944275 shutdown_connections 2023-08-25T09:42:30.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 --2- 172.21.15.89:0/1808944275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f875406e160 0x7f875414c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 --2- 172.21.15.89:0/1808944275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406dd00 0x7f875414c0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 --2- 172.21.15.89:0/1808944275 >> v2:172.21.15.121:3300/0 conn(0x7f8754142bd0 0x7f875406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 -- 172.21.15.89:0/1808944275 >> 172.21.15.89:0/1808944275 conn(0x7f87540babd0 msgr2=0x7f87540bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:30.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 -- 172.21.15.89:0/1808944275 shutdown_connections 2023-08-25T09:42:30.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.546+0000 7f87594bf640 1 -- 172.21.15.89:0/1808944275 wait complete. 2023-08-25T09:42:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.547+0000 7f87594bf640 1 Processor -- start 2023-08-25T09:42:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.547+0000 7f87594bf640 1 -- start start 2023-08-25T09:42:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f875406dd00 0x7f875406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 0x7f8754148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8754142bd0 0x7f8754147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754149070 con 0x7f875406e160 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540a22c0 con 0x7f875406dd00 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87540a25a0 con 0x7f8754142bd0 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 0x7f8754148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 0x7f8754148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52834/0 (socket says 172.21.15.89:52834) 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 -- 172.21.15.89:0/2551602642 learned_addr learned my addr 172.21.15.89:0/2551602642 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f8752ffd640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f875406dd00 0x7f875406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87537fe640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8754142bd0 0x7f8754147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 -- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8754142bd0 msgr2=0x7f8754147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8754142bd0 0x7f8754147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 -- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f875406dd00 msgr2=0x7f875406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f875406dd00 0x7f875406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 -- 172.21.15.89:0/2551602642 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0094d0 con 0x7f875406e160 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f8752ffd640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f875406dd00 0x7f875406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87537fe640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8754142bd0 0x7f8754147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87527fc640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 0x7f8754148b30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f873c000c00 tx=0x7f873c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c039d40 con 0x7f875406e160 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c043400 con 0x7f875406e160 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c039ea0 con 0x7f875406e160 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87540a2880 con 0x7f875406e160 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.548+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87541485a0 con 0x7f875406e160 2023-08-25T09:42:30.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.549+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875404dc40 con 0x7f875406e160 2023-08-25T09:42:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.550+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f873c0437b0 con 0x7f875406e160 2023-08-25T09:42:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.550+0000 7f874b7fe640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f873406a050 0x7f873406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.550+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f873c03e070 con 0x7f875406e160 2023-08-25T09:42:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.550+0000 7f8752ffd640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f873406a050 0x7f873406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.550+0000 7f8752ffd640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f873406a050 0x7f873406c510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f874400a870 tx=0x7f8744008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.554+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f873c076f20 con 0x7f875406e160 2023-08-25T09:42:30.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.719+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f875413ff00 con 0x7f875406e160 2023-08-25T09:42:30.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.720+0000 7f874b7fe640 1 -- 172.21.15.89:0/2551602642 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f873c07a540 con 0x7f875406e160 2023-08-25T09:42:30.722 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T09:42:30.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f873406a050 msgr2=0x7f873406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f873406a050 0x7f873406c510 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f874400a870 tx=0x7f8744008040 comp rx=0 tx=0).stop 2023-08-25T09:42:30.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 msgr2=0x7f8754148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 0x7f8754148b30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f873c000c00 tx=0x7f873c004730 comp rx=0 tx=0).stop 2023-08-25T09:42:30.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 shutdown_connections 2023-08-25T09:42:30.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f873406a050 0x7f873406c510 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f875406e160 0x7f8754148b30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8754142bd0 0x7f8754147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 --2- 172.21.15.89:0/2551602642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f875406dd00 0x7f875406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.721+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 >> 172.21.15.89:0/2551602642 conn(0x7f87540babd0 msgr2=0x7f87540bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:30.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.722+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 shutdown_connections 2023-08-25T09:42:30.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.722+0000 7f87594bf640 1 -- 172.21.15.89:0/2551602642 wait complete. 2023-08-25T09:42:30.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T09:42:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.835+0000 7fe2f8984640 1 Processor -- start 2023-08-25T09:42:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.835+0000 7fe2f8984640 1 -- start start 2023-08-25T09:42:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f8984640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2f40b7bf0 0x7fe2f414a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f8984640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f414e990 0x7fe2f406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f8984640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40b7fd0 con 0x7fe2f40bab10 2023-08-25T09:42:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f8984640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f40b5230 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f8984640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f414def0 con 0x7fe2f414e990 2023-08-25T09:42:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2f40b7bf0 0x7fe2f414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2f40b7bf0 0x7fe2f414a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52836/0 (socket says 172.21.15.89:52836) 2023-08-25T09:42:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 -- 172.21.15.89:0/4259342332 learned_addr learned my addr 172.21.15.89:0/4259342332 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f2d9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe2f40bab10 0x7fe2f40708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59962/0 (socket says 172.21.15.89:59962) 2023-08-25T09:42:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 -- 172.21.15.89:0/4259342332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f414e990 msgr2=0x7fe2f406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 --2- 172.21.15.89:0/4259342332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f414e990 0x7fe2f406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 -- 172.21.15.89:0/4259342332 >> v1:172.21.15.89:6789/0 conn(0x7fe2f40bab10 legacy=0x7fe2f40708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f259c640 1 -- 172.21.15.89:0/4259342332 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f406b180 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.836+0000 7fe2f159a640 1 -- 172.21.15.89:0/4259342332 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514586241 0 0) 0x7fe2ec001110 con 0x7fe2f40bab10 2023-08-25T09:42:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.837+0000 7fe2f259c640 1 --2- 172.21.15.89:0/4259342332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f414a920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009e50 tx=0x7fe2e402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c3bc3a27e7c972 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.837+0000 7fe2f159a640 1 -- 172.21.15.89:0/4259342332 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e402c9e0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.837+0000 7fe2f159a640 1 -- 172.21.15.89:0/4259342332 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e402cb40 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.837+0000 7fe2f159a640 1 -- 172.21.15.89:0/4259342332 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40343f0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 -- 172.21.15.89:0/4259342332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 msgr2=0x7fe2f414a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 --2- 172.21.15.89:0/4259342332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f414a920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009e50 tx=0x7fe2e402be40 comp rx=0 tx=0).stop 2023-08-25T09:42:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 -- 172.21.15.89:0/4259342332 shutdown_connections 2023-08-25T09:42:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 --2- 172.21.15.89:0/4259342332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f414e990 0x7fe2f406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 --2- 172.21.15.89:0/4259342332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f414a920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 -- 172.21.15.89:0/4259342332 >> 172.21.15.89:0/4259342332 conn(0x7fe2f406e560 msgr2=0x7fe2f406e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 -- 172.21.15.89:0/4259342332 shutdown_connections 2023-08-25T09:42:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.838+0000 7fe2f8984640 1 -- 172.21.15.89:0/4259342332 wait complete. 2023-08-25T09:42:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.839+0000 7fe2f8984640 1 Processor -- start 2023-08-25T09:42:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.839+0000 7fe2f8984640 1 -- start start 2023-08-25T09:42:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f4147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f40bab10 0x7fe2f41e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f414e990 0x7fe2f41e0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40ac6f0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f41480f0 con 0x7fe2f414e990 2023-08-25T09:42:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40abea0 con 0x7fe2f40bab10 2023-08-25T09:42:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f4147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f4147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52852/0 (socket says 172.21.15.89:52852) 2023-08-25T09:42:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 -- 172.21.15.89:0/187653355 learned_addr learned my addr 172.21.15.89:0/187653355 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f2d9d640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f414e990 0x7fe2f41e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f1d9b640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f40bab10 0x7fe2f41e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 -- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f40bab10 msgr2=0x7fe2f41e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f40bab10 0x7fe2f41e39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 -- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f414e990 msgr2=0x7fe2f41e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f414e990 0x7fe2f41e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 -- 172.21.15.89:0/187653355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009b30 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f2d9d640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f414e990 0x7fe2f41e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f1d9b640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f40bab10 0x7fe2f41e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f259c640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f4147bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4036040 tx=0x7fe2e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e403e450 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e403e5b0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f41e31e0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e403e940 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.840+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40ad340 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.841+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f40ba2e0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.842+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2e403eaa0 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.842+0000 7fe2e2ffd640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe2d406a050 0x7fe2d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.842+0000 7fe2f1d9b640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe2d406a050 0x7fe2d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.842+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2e40ab610 con 0x7fe2f40b7bf0 2023-08-25T09:42:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.843+0000 7fe2f1d9b640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe2d406a050 0x7fe2d406c510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe2f414c6c0 tx=0x7fe2e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:30.846+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe2e4076d00 con 0x7fe2f40b7bf0 2023-08-25T09:42:31.013 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.010+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2f404dc40 con 0x7fe2f40b7bf0 2023-08-25T09:42:31.015 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.010+0000 7fe2e2ffd640 1 -- 172.21.15.89:0/187653355 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2e407a320 con 0x7fe2f40b7bf0 2023-08-25T09:42:31.017 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T09:42:31.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe2d406a050 msgr2=0x7fe2d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe2d406a050 0x7fe2d406c510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe2f414c6c0 tx=0x7fe2e8008040 comp rx=0 tx=0).stop 2023-08-25T09:42:31.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 msgr2=0x7fe2f4147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f4147bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4036040 tx=0x7fe2e4004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:31.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 shutdown_connections 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe2d406a050 0x7fe2d406c510 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f414e990 0x7fe2f41e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2f40bab10 0x7fe2f41e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 --2- 172.21.15.89:0/187653355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f40b7bf0 0x7fe2f4147bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 >> 172.21.15.89:0/187653355 conn(0x7fe2f406e560 msgr2=0x7fe2f414ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 shutdown_connections 2023-08-25T09:42:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.012+0000 7fe2f8984640 1 -- 172.21.15.89:0/187653355 wait complete. 2023-08-25T09:42:31.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:31.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.123+0000 7f41700f9640 1 Processor -- start 2023-08-25T09:42:31.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f41700f9640 1 -- start start 2023-08-25T09:42:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f41700f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4168144c40 0x7f41680bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f41700f9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f416814ddb0 0x7f416814e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f41700f9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4168145020 con 0x7f41680b6ec0 2023-08-25T09:42:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f41700f9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41680b9330 con 0x7f416814ddb0 2023-08-25T09:42:31.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f41700f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680b7d70 con 0x7f4168144c40 2023-08-25T09:42:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f416d694640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f41680b6ec0 0x7f41680b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59974/0 (socket says 172.21.15.89:59974) 2023-08-25T09:42:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.124+0000 7f416d694640 1 -- 172.21.15.89:0/451998582 learned_addr learned my addr 172.21.15.89:0/451998582 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416de95640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4168144c40 0x7f41680bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633433861 0 0) 0x7f4168145020 con 0x7f41680b6ec0 2023-08-25T09:42:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4154003520 con 0x7f41680b6ec0 2023-08-25T09:42:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 --2- 172.21.15.89:0/451998582 >> v2:172.21.15.121:3300/0 conn(0x7f416814ddb0 0x7f416814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382905216 0 0) 0x7f4154003520 con 0x7f41680b6ec0 2023-08-25T09:42:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4168144c40 msgr2=0x7f41680bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4168144c40 0x7f41680bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 >> v2:172.21.15.121:3300/0 conn(0x7f416814ddb0 msgr2=0x7f416814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 --2- 172.21.15.89:0/451998582 >> v2:172.21.15.121:3300/0 conn(0x7f416814ddb0 0x7f416814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680bd290 con 0x7f41680b6ec0 2023-08-25T09:42:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f4164001670 con 0x7f41680b6ec0 2023-08-25T09:42:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 >> v1:172.21.15.89:6789/0 conn(0x7f41680b6ec0 legacy=0x7f41680b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41540039e0 0x7f4154003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41540047c0 0x7f4154004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4154005180 0x7f415400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680b9330 con 0x7f4154005180 2023-08-25T09:42:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680b7d70 con 0x7f41540047c0 2023-08-25T09:42:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415400bf70 con 0x7f41540039e0 2023-08-25T09:42:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416de95640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4168144c40 0x7f41680bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4154005180 0x7f415400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416d694640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41540047c0 0x7f4154004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416de95640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41540039e0 0x7f4154003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 -- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41540039e0 msgr2=0x7f4154003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41540039e0 0x7f4154003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 -- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41540047c0 msgr2=0x7f4154004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41540047c0 0x7f4154004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.125+0000 7f416e696640 1 -- 172.21.15.89:0/451998582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154003520 con 0x7f4154005180 2023-08-25T09:42:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.126+0000 7f416e696640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4154005180 0x7f415400b980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4160009f90 tx=0x7f41540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92156ed8b1ed3578 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.126+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416002cc20 con 0x7f4154005180 2023-08-25T09:42:31.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.126+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416000f040 con 0x7f4154005180 2023-08-25T09:42:31.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.126+0000 7f416ce93640 1 -- 172.21.15.89:0/451998582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160034440 con 0x7f4154005180 2023-08-25T09:42:31.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f41700f9640 1 -- 172.21.15.89:0/451998582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4154005180 msgr2=0x7f415400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f41700f9640 1 --2- 172.21.15.89:0/451998582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4154005180 0x7f415400b980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4160009f90 tx=0x7f41540057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f416e696640 1 -- 172.21.15.89:0/451998582 reap_dead start 2023-08-25T09:42:31.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f41700f9640 1 -- 172.21.15.89:0/451998582 shutdown_connections 2023-08-25T09:42:31.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f41700f9640 1 -- 172.21.15.89:0/451998582 >> 172.21.15.89:0/451998582 conn(0x7f41680654f0 msgr2=0x7f41680658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f41700f9640 1 -- 172.21.15.89:0/451998582 shutdown_connections 2023-08-25T09:42:31.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.127+0000 7f41700f9640 1 -- 172.21.15.89:0/451998582 wait complete. 2023-08-25T09:42:31.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 Processor -- start 2023-08-25T09:42:31.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 -- start start 2023-08-25T09:42:31.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4154005180 0x7f416814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 0x7f41681e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41680a3a50 0x7f41680a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416814d3b0 con 0x7f416814d680 2023-08-25T09:42:31.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680a4410 con 0x7f4154005180 2023-08-25T09:42:31.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f41700f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680b4230 con 0x7f41680a3a50 2023-08-25T09:42:31.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f416d694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 0x7f41681e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f416d694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 0x7f41681e3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52882/0 (socket says 172.21.15.89:52882) 2023-08-25T09:42:31.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.128+0000 7f416d694640 1 -- 172.21.15.89:0/3495577092 learned_addr learned my addr 172.21.15.89:0/3495577092 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:31.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416de95640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4154005180 0x7f416814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416e696640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41680a3a50 0x7f41680a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416d694640 1 -- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41680a3a50 msgr2=0x7f41680a3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416d694640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41680a3a50 0x7f41680a3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416d694640 1 -- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4154005180 msgr2=0x7f416814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416d694640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4154005180 0x7f416814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416d694640 1 -- 172.21.15.89:0/3495577092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41681444d0 con 0x7f416814d680 2023-08-25T09:42:31.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f416d694640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 0x7f41681e3290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4164007340 tx=0x7f4164007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400f8e0 con 0x7f416814d680 2023-08-25T09:42:31.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416400fa80 con 0x7f416814d680 2023-08-25T09:42:31.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400fe30 con 0x7f416814d680 2023-08-25T09:42:31.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4168143f10 con 0x7f416814d680 2023-08-25T09:42:31.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.129+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41680b3ec0 con 0x7f416814d680 2023-08-25T09:42:31.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.130+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41680b4050 con 0x7f416814d680 2023-08-25T09:42:31.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.131+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f416401d460 con 0x7f416814d680 2023-08-25T09:42:31.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.131+0000 7f415e7fc640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f414c06a080 0x7f414c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.131+0000 7f416de95640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f414c06a080 0x7f414c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.131+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41640888b0 con 0x7f416814d680 2023-08-25T09:42:31.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.132+0000 7f416de95640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f414c06a080 0x7f414c06c540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4158006fd0 tx=0x7f4158008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.135+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4164053fa0 con 0x7f416814d680 2023-08-25T09:42:31.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.335+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41680b8de0 con 0x7f416814d680 2023-08-25T09:42:31.337 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.335+0000 7f415e7fc640 1 -- 172.21.15.89:0/3495577092 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7f41640575c0 con 0x7f416814d680 2023-08-25T09:42:31.337 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:31.338 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:31.338 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:31.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f414c06a080 msgr2=0x7f414c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f414c06a080 0x7f414c06c540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4158006fd0 tx=0x7f4158008040 comp rx=0 tx=0).stop 2023-08-25T09:42:31.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 msgr2=0x7f41681e3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 0x7f41681e3290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4164007340 tx=0x7f4164007800 comp rx=0 tx=0).stop 2023-08-25T09:42:31.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 shutdown_connections 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f414c06a080 0x7f414c06c540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f416814d680 0x7f41681e3290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41680a3a50 0x7f41680a3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 --2- 172.21.15.89:0/3495577092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4154005180 0x7f416814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 >> 172.21.15.89:0/3495577092 conn(0x7f41680654f0 msgr2=0x7f41681d52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 shutdown_connections 2023-08-25T09:42:31.340 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.337+0000 7f41700f9640 1 -- 172.21.15.89:0/3495577092 wait complete. 2023-08-25T09:42:31.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:31.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.449+0000 7fc628f99640 1 Processor -- start 2023-08-25T09:42:31.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.449+0000 7fc628f99640 1 -- start start 2023-08-25T09:42:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc628f99640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc628f99640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc62414ddb0 0x7fc62414e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc628f99640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc624145020 con 0x7fc624144c40 2023-08-25T09:42:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc628f99640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240b9330 con 0x7fc62414ddb0 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc628f99640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b7d70 con 0x7fc6240b6ec0 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc622d9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc62414ddb0 0x7fc62414e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc621d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc62259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc624144c40 0x7fc6240b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:46948/0 (socket says 172.21.15.89:46948) 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.450+0000 7fc62259c640 1 -- 172.21.15.89:0/2596489722 learned_addr learned my addr 172.21.15.89:0/2596489722 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.451+0000 7fc622d9d640 1 -- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 msgr2=0x7fc6240bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.451+0000 7fc622d9d640 1 --2- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.451+0000 7fc622d9d640 1 -- 172.21.15.89:0/2596489722 >> v1:172.21.15.121:6789/0 conn(0x7fc624144c40 legacy=0x7fc6240b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.451+0000 7fc622d9d640 1 -- 172.21.15.89:0/2596489722 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240bd290 con 0x7fc62414ddb0 2023-08-25T09:42:31.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.451+0000 7fc621d9b640 1 --2- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:31.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc622d9d640 1 --2- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62414ddb0 0x7fc62414e240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0097a0 tx=0x7fc61c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18ff00b9b715bf0f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc62159a640 1 -- 172.21.15.89:0/2596489722 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031830 con 0x7fc62414ddb0 2023-08-25T09:42:31.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc62159a640 1 -- 172.21.15.89:0/2596489722 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c031990 con 0x7fc62414ddb0 2023-08-25T09:42:31.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc62159a640 1 -- 172.21.15.89:0/2596489722 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031d20 con 0x7fc62414ddb0 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 -- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62414ddb0 msgr2=0x7fc62414e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 --2- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62414ddb0 0x7fc62414e240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0097a0 tx=0x7fc61c02b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 -- 172.21.15.89:0/2596489722 shutdown_connections 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 --2- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc62414ddb0 0x7fc62414e240 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 --2- 172.21.15.89:0/2596489722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 -- 172.21.15.89:0/2596489722 >> 172.21.15.89:0/2596489722 conn(0x7fc6240654f0 msgr2=0x7fc6240658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 -- 172.21.15.89:0/2596489722 shutdown_connections 2023-08-25T09:42:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.452+0000 7fc628f99640 1 -- 172.21.15.89:0/2596489722 wait complete. 2023-08-25T09:42:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 Processor -- start 2023-08-25T09:42:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 -- start start 2023-08-25T09:42:31.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc624144c40 0x7fc624148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 0x7fc6241e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62414b5c0 con 0x7fc62414ddb0 2023-08-25T09:42:31.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240bf910 con 0x7fc624144c40 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc628f99640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6241488e0 con 0x7fc6240b6ec0 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc622d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 0x7fc6241e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc622d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 0x7fc6241e3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52886/0 (socket says 172.21.15.89:52886) 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc622d9d640 1 -- 172.21.15.89:0/1505571340 learned_addr learned my addr 172.21.15.89:0/1505571340 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc62259c640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.454+0000 7fc621d9b640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc624144c40 0x7fc624148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc622d9d640 1 -- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 msgr2=0x7fc6240bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc622d9d640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc622d9d640 1 -- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc624144c40 msgr2=0x7fc624148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc622d9d640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc624144c40 0x7fc624148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc622d9d640 1 -- 172.21.15.89:0/1505571340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618009400 con 0x7fc62414ddb0 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc622d9d640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 0x7fc6241e3080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc61c034040 tx=0x7fc61c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c03a830 con 0x7fc62414ddb0 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c03a9b0 con 0x7fc62414ddb0 2023-08-25T09:42:31.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c009400 con 0x7fc62414ddb0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c03ad60 con 0x7fc62414ddb0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.455+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6240bfff0 con 0x7fc62414ddb0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.456+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc624148a90 con 0x7fc62414ddb0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.456+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc61c0443f0 con 0x7fc62414ddb0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.457+0000 7fc612ffd640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc60406a080 0x7fc60406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.457+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc61c0aa460 con 0x7fc62414ddb0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.457+0000 7fc62259c640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc60406a080 0x7fc60406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.457+0000 7fc62259c640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc60406a080 0x7fc60406c540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc614005c00 tx=0x7fc614009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.463 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.461+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc624148a90 con 0x7fc62414ddb0 2023-08-25T09:42:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.629+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc624148a90 con 0x7fc62414ddb0 2023-08-25T09:42:31.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.630+0000 7fc612ffd640 1 -- 172.21.15.89:0/1505571340 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fc624148a90 con 0x7fc62414ddb0 2023-08-25T09:42:31.635 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:31.635 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc60406a080 msgr2=0x7fc60406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc60406a080 0x7fc60406c540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc614005c00 tx=0x7fc614009040 comp rx=0 tx=0).stop 2023-08-25T09:42:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 msgr2=0x7fc6241e3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 0x7fc6241e3080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc61c034040 tx=0x7fc61c0046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 shutdown_connections 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc60406a080 0x7fc60406c540 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62414ddb0 0x7fc6241e3080 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc624144c40 0x7fc624148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 --2- 172.21.15.89:0/1505571340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6240b6ec0 0x7fc6240bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 >> 172.21.15.89:0/1505571340 conn(0x7fc6240654f0 msgr2=0x7fc6240bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.632+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 shutdown_connections 2023-08-25T09:42:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.633+0000 7fc628f99640 1 -- 172.21.15.89:0/1505571340 wait complete. 2023-08-25T09:42:31.645 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T09:42:31.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:31.744 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.742+0000 7fcf133e3640 1 Processor -- start 2023-08-25T09:42:31.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.742+0000 7fcf133e3640 1 -- start start 2023-08-25T09:42:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf133e3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcf0c0b7c10 0x7fcf0c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf133e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf0c070fd0 0x7fcf0c141650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf133e3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0b3040 con 0x7fcf0c06fb00 2023-08-25T09:42:31.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf133e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0b27a0 con 0x7fcf0c070fd0 2023-08-25T09:42:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf133e3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0b2a80 con 0x7fcf0c0b7c10 2023-08-25T09:42:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf0c070fd0 0x7fcf0c141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf0c070fd0 0x7fcf0c141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52890/0 (socket says 172.21.15.89:52890) 2023-08-25T09:42:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 -- 172.21.15.89:0/1202292502 learned_addr learned my addr 172.21.15.89:0/1202292502 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:31.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf11980640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcf0c06fb00 0x7fcf0c0b88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59982/0 (socket says 172.21.15.89:59982) 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1117f640 1 --2- 172.21.15.89:0/1202292502 >> v2:172.21.15.121:3300/0 conn(0x7fcf0c0b7c10 0x7fcf0c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 -- 172.21.15.89:0/1202292502 >> v2:172.21.15.121:3300/0 conn(0x7fcf0c0b7c10 msgr2=0x7fcf0c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf03fff640 1 -- 172.21.15.89:0/1202292502 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053771360 0 0) 0x7fcf0c0b3040 con 0x7fcf0c06fb00 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 --2- 172.21.15.89:0/1202292502 >> v2:172.21.15.121:3300/0 conn(0x7fcf0c0b7c10 0x7fcf0c070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 -- 172.21.15.89:0/1202292502 >> v1:172.21.15.89:6789/0 conn(0x7fcf0c06fb00 legacy=0x7fcf0c0b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1097e640 1 -- 172.21.15.89:0/1202292502 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0b2d60 con 0x7fcf0c070fd0 2023-08-25T09:42:31.749 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.743+0000 7fcf1117f640 1 --2- 172.21.15.89:0/1202292502 >> v2:172.21.15.121:3300/0 conn(0x7fcf0c0b7c10 0x7fcf0c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.744+0000 7fcf1097e640 1 --2- 172.21.15.89:0/1202292502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c141650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c06cf30 tx=0x7fcefc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edf152c5452a827 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.744+0000 7fcf03fff640 1 -- 172.21.15.89:0/1202292502 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc02f850 con 0x7fcf0c070fd0 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.744+0000 7fcf03fff640 1 -- 172.21.15.89:0/1202292502 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc02f9b0 con 0x7fcf0c070fd0 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.744+0000 7fcf03fff640 1 -- 172.21.15.89:0/1202292502 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc02fd40 con 0x7fcf0c070fd0 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 -- 172.21.15.89:0/1202292502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c070fd0 msgr2=0x7fcf0c141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1202292502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c141650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c06cf30 tx=0x7fcefc02ba30 comp rx=0 tx=0).stop 2023-08-25T09:42:31.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 -- 172.21.15.89:0/1202292502 shutdown_connections 2023-08-25T09:42:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1202292502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c141650 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1202292502 >> v2:172.21.15.121:3300/0 conn(0x7fcf0c0b7c10 0x7fcf0c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 -- 172.21.15.89:0/1202292502 >> 172.21.15.89:0/1202292502 conn(0x7fcf0c069a30 msgr2=0x7fcf0c069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 -- 172.21.15.89:0/1202292502 shutdown_connections 2023-08-25T09:42:31.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.745+0000 7fcf133e3640 1 -- 172.21.15.89:0/1202292502 wait complete. 2023-08-25T09:42:31.753 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.746+0000 7fcf133e3640 1 Processor -- start 2023-08-25T09:42:31.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.746+0000 7fcf133e3640 1 -- start start 2023-08-25T09:42:31.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 0x7fcf0c13f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c0bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf0c0b7c10 0x7fcf0c0bb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c13f900 con 0x7fcf0c06fb00 2023-08-25T09:42:31.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c139b70 con 0x7fcf0c070fd0 2023-08-25T09:42:31.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0b9e90 con 0x7fcf0c0b7c10 2023-08-25T09:42:31.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 0x7fcf0c13f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 0x7fcf0c13f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52906/0 (socket says 172.21.15.89:52906) 2023-08-25T09:42:31.755 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 -- 172.21.15.89:0/1407249296 learned_addr learned my addr 172.21.15.89:0/1407249296 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1097e640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c0bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf11980640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf0c0b7c10 0x7fcf0c0bb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 -- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf0c0b7c10 msgr2=0x7fcf0c0bb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf0c0b7c10 0x7fcf0c0bb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 -- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf0c070fd0 msgr2=0x7fcf0c0bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c0bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 -- 172.21.15.89:0/1407249296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0094d0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf1117f640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 0x7fcf0c13f3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800ce00 tx=0x7fcf0800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800f890 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800f9f0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c0ba530 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.747+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800fdc0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.748+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c0baaf0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.748+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c073bf0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.749+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf0800b040 con 0x7fcf0c06fb00 2023-08-25T09:42:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.749+0000 7fcf01ffb640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcef006a050 0x7fcef006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.749+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf08088f00 con 0x7fcf0c06fb00 2023-08-25T09:42:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.749+0000 7fcf1097e640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcef006a050 0x7fcef006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.749+0000 7fcf1097e640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcef006a050 0x7fcef006c510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcefc036000 tx=0x7fcefc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:31.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.753+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf080546a0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.952+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf0c06a1d0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.952+0000 7fcf01ffb640 1 -- 172.21.15.89:0/1407249296 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7fcf08057cc0 con 0x7fcf0c06fb00 2023-08-25T09:42:31.954 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:31.954 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:31.955 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:31.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcef006a050 msgr2=0x7fcef006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcef006a050 0x7fcef006c510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcefc036000 tx=0x7fcefc008030 comp rx=0 tx=0).stop 2023-08-25T09:42:31.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 msgr2=0x7fcf0c13f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:31.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 0x7fcf0c13f3c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800ce00 tx=0x7fcf0800a650 comp rx=0 tx=0).stop 2023-08-25T09:42:31.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 shutdown_connections 2023-08-25T09:42:31.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcef006a050 0x7fcef006c510 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcf0c0b7c10 0x7fcf0c0bb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf0c070fd0 0x7fcf0c0bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 --2- 172.21.15.89:0/1407249296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf0c06fb00 0x7fcf0c13f3c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:31.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 >> 172.21.15.89:0/1407249296 conn(0x7fcf0c069a30 msgr2=0x7fcf0c0b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:31.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 shutdown_connections 2023-08-25T09:42:31.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:31.954+0000 7fcf133e3640 1 -- 172.21.15.89:0/1407249296 wait complete. 2023-08-25T09:42:31.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:32.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.063+0000 7fadb1626640 1 Processor -- start 2023-08-25T09:42:32.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.064+0000 7fadb1626640 1 -- start start 2023-08-25T09:42:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.064+0000 7fadb1626640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fadac144c40 0x7fadac0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.064+0000 7fadb1626640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac14ddb0 0x7fadac14e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.064+0000 7fadb1626640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac145020 con 0x7fadac0b6ec0 2023-08-25T09:42:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.064+0000 7fadb1626640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac0b9330 con 0x7fadac144c40 2023-08-25T09:42:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.064+0000 7fadb1626640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0b7d70 con 0x7fadac14ddb0 2023-08-25T09:42:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadab7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac14ddb0 0x7fadac14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadaaffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fadac144c40 0x7fadac0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadaa7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fadac0b6ec0 0x7fadac0b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:46954/0 (socket says 172.21.15.89:46954) 2023-08-25T09:42:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadaa7fc640 1 -- 172.21.15.89:0/4104033436 learned_addr learned my addr 172.21.15.89:0/4104033436 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadab7fe640 1 -- 172.21.15.89:0/4104033436 >> v2:172.21.15.121:3300/0 conn(0x7fadac144c40 msgr2=0x7fadac0bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadab7fe640 1 --2- 172.21.15.89:0/4104033436 >> v2:172.21.15.121:3300/0 conn(0x7fadac144c40 0x7fadac0bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadab7fe640 1 -- 172.21.15.89:0/4104033436 >> v1:172.21.15.121:6789/0 conn(0x7fadac0b6ec0 legacy=0x7fadac0b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadab7fe640 1 -- 172.21.15.89:0/4104033436 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0bd290 con 0x7fadac14ddb0 2023-08-25T09:42:32.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.065+0000 7fadaaffd640 1 --2- 172.21.15.89:0/4104033436 >> v2:172.21.15.121:3300/0 conn(0x7fadac144c40 0x7fadac0bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadab7fe640 1 --2- 172.21.15.89:0/4104033436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac14ddb0 0x7fadac14e240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009d90 tx=0x7fad9c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=925cefb8dd8b5827 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fada9ffb640 1 -- 172.21.15.89:0/4104033436 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c02cc50 con 0x7fadac14ddb0 2023-08-25T09:42:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fada9ffb640 1 -- 172.21.15.89:0/4104033436 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c02cdb0 con 0x7fadac14ddb0 2023-08-25T09:42:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fada9ffb640 1 -- 172.21.15.89:0/4104033436 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c034660 con 0x7fadac14ddb0 2023-08-25T09:42:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 -- 172.21.15.89:0/4104033436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac14ddb0 msgr2=0x7fadac14e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 --2- 172.21.15.89:0/4104033436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac14ddb0 0x7fadac14e240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009d90 tx=0x7fad9c02bea0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 -- 172.21.15.89:0/4104033436 shutdown_connections 2023-08-25T09:42:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 --2- 172.21.15.89:0/4104033436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac14ddb0 0x7fadac14e240 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 --2- 172.21.15.89:0/4104033436 >> v2:172.21.15.121:3300/0 conn(0x7fadac144c40 0x7fadac0bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 -- 172.21.15.89:0/4104033436 >> 172.21.15.89:0/4104033436 conn(0x7fadac0654f0 msgr2=0x7fadac0658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:32.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 -- 172.21.15.89:0/4104033436 shutdown_connections 2023-08-25T09:42:32.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.066+0000 7fadb1626640 1 -- 172.21.15.89:0/4104033436 wait complete. 2023-08-25T09:42:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.067+0000 7fadb1626640 1 Processor -- start 2023-08-25T09:42:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 -- start start 2023-08-25T09:42:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 0x7fadac0c0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac144c40 0x7fadac0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadac14ddb0 0x7fadac1e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1e00f0 con 0x7fadac0b6ec0 2023-08-25T09:42:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0be320 con 0x7fadac14ddb0 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadb1626640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0c0800 con 0x7fadac144c40 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadaaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 0x7fadac0c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadaaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 0x7fadac0c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52912/0 (socket says 172.21.15.89:52912) 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadaaffd640 1 -- 172.21.15.89:0/2328845049 learned_addr learned my addr 172.21.15.89:0/2328845049 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadaa7fc640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac144c40 0x7fadac0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.068+0000 7fadab7fe640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadac14ddb0 0x7fadac1e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaaffd640 1 -- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac144c40 msgr2=0x7fadac0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaaffd640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac144c40 0x7fadac0b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaaffd640 1 -- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadac14ddb0 msgr2=0x7fadac1e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaaffd640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadac14ddb0 0x7fadac1e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaaffd640 1 -- 172.21.15.89:0/2328845049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4009400 con 0x7fadac0b6ec0 2023-08-25T09:42:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadab7fe640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadac14ddb0 0x7fadac1e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:32.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaa7fc640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac144c40 0x7fadac0b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:32.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadaaffd640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 0x7fadac0c0140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fada400ebe0 tx=0x7fada400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4009760 con 0x7fadac0b6ec0 2023-08-25T09:42:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c009a70 con 0x7fadac0b6ec0 2023-08-25T09:42:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada400cc30 con 0x7fadac0b6ec0 2023-08-25T09:42:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400eee0 con 0x7fadac0b6ec0 2023-08-25T09:42:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.069+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac1e0390 con 0x7fadac0b6ec0 2023-08-25T09:42:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.070+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac14ae80 con 0x7fadac0b6ec0 2023-08-25T09:42:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.070+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fada4013470 con 0x7fadac0b6ec0 2023-08-25T09:42:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.071+0000 7fad937fe640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fad9806a050 0x7fad9806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.071+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fada4088910 con 0x7fadac0b6ec0 2023-08-25T09:42:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.071+0000 7fadaa7fc640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fad9806a050 0x7fad9806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.071+0000 7fadaa7fc640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fad9806a050 0x7fad9806c510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fadac0b2600 tx=0x7fada0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.075+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fada4057aa0 con 0x7fadac0b6ec0 2023-08-25T09:42:32.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.275+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadac073bf0 con 0x7fadac0b6ec0 2023-08-25T09:42:32.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.276+0000 7fad937fe640 1 -- 172.21.15.89:0/2328845049 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4082 (secure 0 0 0) 0x7fada4057630 con 0x7fadac0b6ec0 2023-08-25T09:42:32.279 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:32.279 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3997375942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3997375942},{"type":"v1","addr":"172.21.15.89:6835","nonce":3997375942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2340556800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2340556800},{"type":"v1","addr":"172.21.15.121:6833","nonce":2340556800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:00.621769+0000","modified":"2023-08-25T09:42:03.271371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2092474758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2092474758},{"type":"v1","addr":"172.21.15.89:6837","nonce":2092474758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T09:42:32.280 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2023-08-25T09:42:32.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.277+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fad9806a050 msgr2=0x7fad9806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.277+0000 7fadb1626640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fad9806a050 0x7fad9806c510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fadac0b2600 tx=0x7fada0009040 comp rx=0 tx=0).stop 2023-08-25T09:42:32.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.277+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 msgr2=0x7fadac0c0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.277+0000 7fadb1626640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 0x7fadac0c0140 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fada400ebe0 tx=0x7fada400c520 comp rx=0 tx=0).stop 2023-08-25T09:42:32.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 shutdown_connections 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fad9806a050 0x7fad9806c510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadac14ddb0 0x7fadac1e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadac144c40 0x7fadac0b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 --2- 172.21.15.89:0/2328845049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadac0b6ec0 0x7fadac0c0140 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 >> 172.21.15.89:0/2328845049 conn(0x7fadac0654f0 msgr2=0x7fadac143310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 shutdown_connections 2023-08-25T09:42:32.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.278+0000 7fadb1626640 1 -- 172.21.15.89:0/2328845049 wait complete. 2023-08-25T09:42:32.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:32.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.389+0000 7f90a3006640 1 Processor -- start 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.389+0000 7f90a3006640 1 -- start start 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a3006640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f909c06f060 0x7f909c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a3006640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0b3040 con 0x7f909c0b7c10 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a3006640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0b27a0 con 0x7f909c06fb00 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a3006640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c0b2a80 con 0x7f909c06f060 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a0da2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f909c0b7c10 0x7f909c070a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:59998/0 (socket says 172.21.15.89:59998) 2023-08-25T09:42:32.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a0da2640 1 -- 172.21.15.89:0/2312577928 learned_addr learned my addr 172.21.15.89:0/2312577928 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205825303 0 0) 0x7f909c0b3040 con 0x7f909c0b7c10 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9084003520 con 0x7f909c0b7c10 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f90a15a3640 1 --2- 172.21.15.89:0/2312577928 >> v2:172.21.15.121:3300/0 conn(0x7f909c06f060 0x7f909c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1348353359 0 0) 0x7f9084003520 con 0x7f909c0b7c10 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 >> v2:172.21.15.121:3300/0 conn(0x7f909c06f060 msgr2=0x7f909c152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f909b7fe640 1 --2- 172.21.15.89:0/2312577928 >> v2:172.21.15.121:3300/0 conn(0x7f909c06f060 0x7f909c152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.390+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 >> v1:172.21.15.121:6789/0 conn(0x7f909c06fb00 legacy=0x7f909c141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0b2d60 con 0x7f909c0b7c10 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f908c001670 con 0x7f909c0b7c10 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 >> v1:172.21.15.89:6789/0 conn(0x7f909c0b7c10 legacy=0x7f909c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90840039e0 0x7f9084003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90840047c0 0x7f9084004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840051f0 0x7f908400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0b2a80 con 0x7f90840047c0 2023-08-25T09:42:32.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908400c140 con 0x7f90840039e0 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908400c300 con 0x7f90840051f0 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909bfff640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90840047c0 0x7f9084004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f90a0da2640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90840039e0 0x7f9084003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f90a15a3640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840051f0 0x7f908400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909bfff640 1 -- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840051f0 msgr2=0x7f908400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909bfff640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840051f0 0x7f908400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909bfff640 1 -- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90840039e0 msgr2=0x7f9084003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:32.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909bfff640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90840039e0 0x7f9084003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f909bfff640 1 -- 172.21.15.89:0/2312577928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084003520 con 0x7f90840047c0 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f90a15a3640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840051f0 0x7f908400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.391+0000 7f90a15a3640 1 -- 172.21.15.89:0/2312577928 reap_dead start 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f909bfff640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90840047c0 0x7f9084004c40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9090001720 tx=0x7f90840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677e2488772a1b5c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900052d0 con 0x7f90840047c0 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909002e050 con 0x7f90840047c0 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f909b7fe640 1 -- 172.21.15.89:0/2312577928 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090003830 con 0x7f90840047c0 2023-08-25T09:42:32.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 -- 172.21.15.89:0/2312577928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90840047c0 msgr2=0x7f9084004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90840047c0 0x7f9084004c40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9090001720 tx=0x7f90840057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 -- 172.21.15.89:0/2312577928 shutdown_connections 2023-08-25T09:42:32.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 --2- 172.21.15.89:0/2312577928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90840047c0 0x7f9084004c40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 -- 172.21.15.89:0/2312577928 >> 172.21.15.89:0/2312577928 conn(0x7f909c069a30 msgr2=0x7f909c069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:32.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 -- 172.21.15.89:0/2312577928 shutdown_connections 2023-08-25T09:42:32.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.392+0000 7f90a3006640 1 -- 172.21.15.89:0/2312577928 wait complete. 2023-08-25T09:42:32.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.393+0000 7f90a3006640 1 Processor -- start 2023-08-25T09:42:32.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.393+0000 7f90a3006640 1 -- start start 2023-08-25T09:42:32.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a3006640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840047c0 0x7f909c0ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a3006640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 0x7f909c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a3006640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c0b6890 0x7f909c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a3006640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0bb6f0 con 0x7f909c1e0b80 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a3006640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c147ee0 con 0x7f909c0b6890 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a3006640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1e0fe0 con 0x7f90840047c0 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f909bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 0x7f909c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f909bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 0x7f909c1479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52938/0 (socket says 172.21.15.89:52938) 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f909bfff640 1 -- 172.21.15.89:0/1737502912 learned_addr learned my addr 172.21.15.89:0/1737502912 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a0da2640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840047c0 0x7f909c0ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.394+0000 7f90a15a3640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c0b6890 0x7f909c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f909bfff640 1 -- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840047c0 msgr2=0x7f909c0ba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f909bfff640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840047c0 0x7f909c0ba6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f909bfff640 1 -- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c0b6890 msgr2=0x7f909c0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f909bfff640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c0b6890 0x7f909c0b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f909bfff640 1 -- 172.21.15.89:0/1737502912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0b71b0 con 0x7f909c1e0b80 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90a15a3640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c0b6890 0x7f909c0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90a0da2640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840047c0 0x7f909c0ba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f909bfff640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 0x7f909c1479a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f909002bbc0 tx=0x7f9090001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900076c0 con 0x7f909c1e0b80 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090007a30 con 0x7f909c1e0b80 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c0b9ec0 con 0x7f909c1e0b80 2023-08-25T09:42:32.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090006be0 con 0x7f909c1e0b80 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.395+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c1482b0 con 0x7f909c1e0b80 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.396+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0b9d20 con 0x7f909c1e0b80 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.396+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9090006d40 con 0x7f909c1e0b80 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.397+0000 7f90997fa640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f908806a050 0x7f908806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.397+0000 7f90a0da2640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f908806a050 0x7f908806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.397+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90900aa230 con 0x7f909c1e0b80 2023-08-25T09:42:32.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.397+0000 7f90a0da2640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f908806a050 0x7f908806c510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f908c007c60 tx=0x7f908c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.401+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f909c0b9d20 con 0x7f909c1e0b80 2023-08-25T09:42:32.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.571+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f909c0b9d20 con 0x7f909c1e0b80 2023-08-25T09:42:32.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.572+0000 7f90997fa640 1 -- 172.21.15.89:0/1737502912 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f909c0b9d20 con 0x7f909c1e0b80 2023-08-25T09:42:32.575 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:32.576 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:02.250620+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:41:58.960870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T09:41:59.553666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:32.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f908806a050 msgr2=0x7f908806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f908806a050 0x7f908806c510 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f908c007c60 tx=0x7f908c009040 comp rx=0 tx=0).stop 2023-08-25T09:42:32.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 msgr2=0x7f909c1479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 0x7f909c1479a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f909002bbc0 tx=0x7f9090001120 comp rx=0 tx=0).stop 2023-08-25T09:42:32.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 shutdown_connections 2023-08-25T09:42:32.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f908806a050 0x7f908806c510 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f909c1e0b80 0x7f909c1479a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f909c0b6890 0x7f909c0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 --2- 172.21.15.89:0/1737502912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90840047c0 0x7f909c0ba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 >> 172.21.15.89:0/1737502912 conn(0x7f909c069a30 msgr2=0x7f909c13e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 shutdown_connections 2023-08-25T09:42:32.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.574+0000 7f90a3006640 1 -- 172.21.15.89:0/1737502912 wait complete. 2023-08-25T09:42:32.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T09:42:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.688+0000 7f12bebab640 1 Processor -- start 2023-08-25T09:42:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.688+0000 7f12bebab640 1 -- start start 2023-08-25T09:42:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bebab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12b8144c40 0x7f12b80bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bebab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b80b6ec0 0x7f12b80b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bebab640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b8145020 con 0x7f12b814ddb0 2023-08-25T09:42:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bebab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b80b9330 con 0x7f12b8144c40 2023-08-25T09:42:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bebab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80bd290 con 0x7f12b80b6ec0 2023-08-25T09:42:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bc947640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12b8144c40 0x7f12b80bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bd148640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f12b814ddb0 0x7f12b80babe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60008/0 (socket says 172.21.15.89:60008) 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bd148640 1 -- 172.21.15.89:0/1940799945 learned_addr learned my addr 172.21.15.89:0/1940799945 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12b7fff640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b80b6ec0 0x7f12b80b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bc947640 1 -- 172.21.15.89:0/1940799945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b80b6ec0 msgr2=0x7f12b80b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bc947640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b80b6ec0 0x7f12b80b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bc947640 1 -- 172.21.15.89:0/1940799945 >> v1:172.21.15.89:6789/0 conn(0x7f12b814ddb0 legacy=0x7f12b80babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12b77fe640 1 -- 172.21.15.89:0/1940799945 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340310415 0 0) 0x7f12b8145020 con 0x7f12b814ddb0 2023-08-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12bc947640 1 -- 172.21.15.89:0/1940799945 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80b8850 con 0x7f12b8144c40 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.689+0000 7f12b7fff640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b80b6ec0 0x7f12b80b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.690+0000 7f12bc947640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8144c40 0x7f12b80bcc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009d90 tx=0x7f12b002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458679bf692d3c1f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.690+0000 7f12b77fe640 1 -- 172.21.15.89:0/1940799945 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b002cc50 con 0x7f12b8144c40 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.690+0000 7f12b77fe640 1 -- 172.21.15.89:0/1940799945 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b002cdb0 con 0x7f12b8144c40 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.690+0000 7f12b77fe640 1 -- 172.21.15.89:0/1940799945 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0034660 con 0x7f12b8144c40 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 -- 172.21.15.89:0/1940799945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8144c40 msgr2=0x7f12b80bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8144c40 0x7f12b80bcc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009d90 tx=0x7f12b002bea0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 -- 172.21.15.89:0/1940799945 shutdown_connections 2023-08-25T09:42:32.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b80b6ec0 0x7f12b80b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 --2- 172.21.15.89:0/1940799945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8144c40 0x7f12b80bcc70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 -- 172.21.15.89:0/1940799945 >> 172.21.15.89:0/1940799945 conn(0x7f12b80654f0 msgr2=0x7f12b80658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:32.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 -- 172.21.15.89:0/1940799945 shutdown_connections 2023-08-25T09:42:32.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.691+0000 7f12bebab640 1 -- 172.21.15.89:0/1940799945 wait complete. 2023-08-25T09:42:32.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.692+0000 7f12bebab640 1 Processor -- start 2023-08-25T09:42:32.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.692+0000 7f12bebab640 1 -- start start 2023-08-25T09:42:32.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12b80b6ec0 0x7f12b814ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b8144c40 0x7f12b8147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 0x7f12b8147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8147190 con 0x7f12b814ddb0 2023-08-25T09:42:32.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b81e3850 con 0x7f12b80b6ec0 2023-08-25T09:42:32.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b81e3b30 con 0x7f12b8144c40 2023-08-25T09:42:32.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 0x7f12b8147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 0x7f12b8147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52946/0 (socket says 172.21.15.89:52946) 2023-08-25T09:42:32.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 -- 172.21.15.89:0/3057475420 learned_addr learned my addr 172.21.15.89:0/3057475420 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:32.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12b7fff640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b8144c40 0x7f12b8147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bc947640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12b80b6ec0 0x7f12b814ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 -- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b8144c40 msgr2=0x7f12b8147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b8144c40 0x7f12b8147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 -- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12b80b6ec0 msgr2=0x7f12b814ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12b80b6ec0 0x7f12b814ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 -- 172.21.15.89:0/3057475420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0009a70 con 0x7f12b814ddb0 2023-08-25T09:42:32.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bd148640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 0x7f12b8147b60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f12a800c410 tx=0x7f12a800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80074e0 con 0x7f12b814ddb0 2023-08-25T09:42:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a8007640 con 0x7f12b814ddb0 2023-08-25T09:42:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b81e3e10 con 0x7f12b814ddb0 2023-08-25T09:42:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.693+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8004a20 con 0x7f12b814ddb0 2023-08-25T09:42:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.694+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b81e3520 con 0x7f12b814ddb0 2023-08-25T09:42:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.694+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b8147340 con 0x7f12b814ddb0 2023-08-25T09:42:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.695+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12a8004b80 con 0x7f12b814ddb0 2023-08-25T09:42:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.695+0000 7f12b57fa640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f129806a050 0x7f129806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:32.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.695+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12a8088200 con 0x7f12b814ddb0 2023-08-25T09:42:32.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.695+0000 7f12bc947640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f129806a050 0x7f129806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:32.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.696+0000 7f12bc947640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f129806a050 0x7f129806c510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f12b0036000 tx=0x7f12b0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:32.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.699+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12b8147340 con 0x7f12b814ddb0 2023-08-25T09:42:32.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.901+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f12b80b6750 con 0x7f12b814ddb0 2023-08-25T09:42:32.903 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-08-25T09:42:32.901+0000 7f2c986e4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T09:42:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.905+0000 7f12b57fa640 1 -- 172.21.15.89:0/3057475420 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f12a8057430 con 0x7f12b814ddb0 2023-08-25T09:42:32.907 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T09:42:32.909 INFO:tasks.ceph.mds.c.smithi089.stderr: -4727> 2023-08-25T09:42:06.332+0000 7fa1dbddc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T09:42:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f129806a050 msgr2=0x7f129806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f129806a050 0x7f129806c510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f12b0036000 tx=0x7f12b0030000 comp rx=0 tx=0).stop 2023-08-25T09:42:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 msgr2=0x7f12b8147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 0x7f12b8147b60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f12a800c410 tx=0x7f12a800c8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 shutdown_connections 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f129806a050 0x7f129806c510 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b814ddb0 0x7f12b8147b60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12b8144c40 0x7f12b8147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 --2- 172.21.15.89:0/3057475420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12b80b6ec0 0x7f12b814ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.907+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 >> 172.21.15.89:0/3057475420 conn(0x7f12b80654f0 msgr2=0x7f12b80bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.908+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 shutdown_connections 2023-08-25T09:42:32.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:32.908+0000 7f12bebab640 1 -- 172.21.15.89:0/3057475420 wait complete. 2023-08-25T09:42:32.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T09:42:32.937 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-08-25T09:42:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 Processor -- start 2023-08-25T09:42:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 -- start start 2023-08-25T09:42:33.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40b7bf0 0x7f8df414a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:33.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8df40bab10 0x7f8df4155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:33.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df40b7fd0 con 0x7f8df414e990 2023-08-25T09:42:33.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40b5230 con 0x7f8df40bab10 2023-08-25T09:42:33.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.024+0000 7f8df952f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df414def0 con 0x7f8df40b7bf0 2023-08-25T09:42:33.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df2ffd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40b7bf0 0x7f8df414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:33.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8dea7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8df414e990 0x7f8df406a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:46992/0 (socket says 172.21.15.89:46992) 2023-08-25T09:42:33.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df37fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8df40bab10 0x7f8df4155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:33.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8dea7fc640 1 -- 172.21.15.89:0/9830065 learned_addr learned my addr 172.21.15.89:0/9830065 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:33.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df2ffd640 1 -- 172.21.15.89:0/9830065 >> v2:172.21.15.121:3300/0 conn(0x7f8df40bab10 msgr2=0x7f8df4155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:33.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df2ffd640 1 --2- 172.21.15.89:0/9830065 >> v2:172.21.15.121:3300/0 conn(0x7f8df40bab10 0x7f8df4155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df2ffd640 1 -- 172.21.15.89:0/9830065 >> v1:172.21.15.121:6789/0 conn(0x7f8df414e990 legacy=0x7f8df406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df2ffd640 1 -- 172.21.15.89:0/9830065 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df406b180 con 0x7f8df40b7bf0 2023-08-25T09:42:33.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.025+0000 7f8df37fe640 1 --2- 172.21.15.89:0/9830065 >> v2:172.21.15.121:3300/0 conn(0x7f8df40bab10 0x7f8df4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:33.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.026+0000 7f8df2ffd640 1 --2- 172.21.15.89:0/9830065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40b7bf0 0x7f8df414a920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8de40097a0 tx=0x7f8de402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e19b5509b379f6a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:33.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.026+0000 7f8df27fc640 1 -- 172.21.15.89:0/9830065 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de402f050 con 0x7f8df40b7bf0 2023-08-25T09:42:33.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.026+0000 7f8df27fc640 1 -- 172.21.15.89:0/9830065 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4031700 con 0x7f8df40b7bf0 2023-08-25T09:42:33.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.026+0000 7f8df27fc640 1 -- 172.21.15.89:0/9830065 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4031a90 con 0x7f8df40b7bf0 2023-08-25T09:42:33.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 -- 172.21.15.89:0/9830065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40b7bf0 msgr2=0x7f8df414a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:33.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 --2- 172.21.15.89:0/9830065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40b7bf0 0x7f8df414a920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8de40097a0 tx=0x7f8de402b7a0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 -- 172.21.15.89:0/9830065 shutdown_connections 2023-08-25T09:42:33.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 --2- 172.21.15.89:0/9830065 >> v2:172.21.15.121:3300/0 conn(0x7f8df40bab10 0x7f8df4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 --2- 172.21.15.89:0/9830065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40b7bf0 0x7f8df414a920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 -- 172.21.15.89:0/9830065 >> 172.21.15.89:0/9830065 conn(0x7f8df406e560 msgr2=0x7f8df406e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:33.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 -- 172.21.15.89:0/9830065 shutdown_connections 2023-08-25T09:42:33.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.027+0000 7f8df952f640 1 -- 172.21.15.89:0/9830065 wait complete. 2023-08-25T09:42:33.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 Processor -- start 2023-08-25T09:42:33.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 -- start start 2023-08-25T09:42:33.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 0x7f8df40bc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:33.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40bab10 0x7f8df41499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:33.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8df414e990 0x7f8df41463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:33.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40bc540 con 0x7f8df40b7bf0 2023-08-25T09:42:33.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df4149f00 con 0x7f8df414e990 2023-08-25T09:42:33.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.028+0000 7f8df952f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40be880 con 0x7f8df40bab10 2023-08-25T09:42:33.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 0x7f8df40bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:33.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 0x7f8df40bc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52962/0 (socket says 172.21.15.89:52962) 2023-08-25T09:42:33.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 -- 172.21.15.89:0/246725976 learned_addr learned my addr 172.21.15.89:0/246725976 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:33.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df37fe640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8df414e990 0x7f8df41463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:33.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8dea7fc640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40bab10 0x7f8df41499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:33.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 -- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40bab10 msgr2=0x7f8df41499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:33.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40bab10 0x7f8df41499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 -- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8df414e990 msgr2=0x7f8df41463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:33.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8df414e990 0x7f8df41463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 -- 172.21.15.89:0/246725976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec009a70 con 0x7f8df40b7bf0 2023-08-25T09:42:33.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df2ffd640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 0x7f8df40bc000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8de4036040 tx=0x7f8de40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:33.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4031500 con 0x7f8df40b7bf0 2023-08-25T09:42:33.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4033930 con 0x7f8df40b7bf0 2023-08-25T09:42:33.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de4009400 con 0x7f8df40b7bf0 2023-08-25T09:42:33.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4033ce0 con 0x7f8df40b7bf0 2023-08-25T09:42:33.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.029+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df40bead0 con 0x7f8df40b7bf0 2023-08-25T09:42:33.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.030+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df404dc40 con 0x7f8df40b7bf0 2023-08-25T09:42:33.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.031+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8de403a040 con 0x7f8df40b7bf0 2023-08-25T09:42:33.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.031+0000 7f8debfff640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8dd406a050 0x7f8dd406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:33.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.031+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8de40a9810 con 0x7f8df40b7bf0 2023-08-25T09:42:33.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.031+0000 7f8dea7fc640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8dd406a050 0x7f8dd406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:33.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.031+0000 7f8dea7fc640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8dd406a050 0x7f8dd406c510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8df41dd480 tx=0x7f8ddc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:33.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.035+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8de4074e10 con 0x7f8df40b7bf0 2023-08-25T09:42:33.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.235+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8df40ba150 con 0x7f8df40b7bf0 2023-08-25T09:42:33.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.906+0000 7f8debfff640 1 -- 172.21.15.89:0/246725976 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8de40380a0 con 0x7f8df40b7bf0 2023-08-25T09:42:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8dd406a050 msgr2=0x7f8dd406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8dd406a050 0x7f8dd406c510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8df41dd480 tx=0x7f8ddc009040 comp rx=0 tx=0).stop 2023-08-25T09:42:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 msgr2=0x7f8df40bc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 0x7f8df40bc000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8de4036040 tx=0x7f8de40046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 shutdown_connections 2023-08-25T09:42:33.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8dd406a050 0x7f8dd406c510 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8df414e990 0x7f8df41463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8df40bab10 0x7f8df41499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 --2- 172.21.15.89:0/246725976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8df40b7bf0 0x7f8df40bc000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 >> 172.21.15.89:0/246725976 conn(0x7f8df406e560 msgr2=0x7f8df414c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 shutdown_connections 2023-08-25T09:42:33.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:33.908+0000 7f8df952f640 1 -- 172.21.15.89:0/246725976 wait complete. 2023-08-25T09:42:33.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T09:42:34.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.067+0000 7f60c5da2640 1 Processor -- start 2023-08-25T09:42:34.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.067+0000 7f60c5da2640 1 -- start start 2023-08-25T09:42:34.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c5da2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60c00bc600 0x7f60c00b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:34.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c5da2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60c00b66d0 0x7f60c0144130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:34.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c5da2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c00b6c20 con 0x7f60c00b5470 2023-08-25T09:42:34.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c5da2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c014b640 con 0x7f60c00bc600 2023-08-25T09:42:34.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c5da2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c00b6f00 con 0x7f60c00b66d0 2023-08-25T09:42:34.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c4da0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f60c00b5470 0x7f60c014af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60024/0 (socket says 172.21.15.89:60024) 2023-08-25T09:42:34.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60c4da0640 1 -- 172.21.15.89:0/502710728 learned_addr learned my addr 172.21.15.89:0/502710728 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60bffff640 1 --2- 172.21.15.89:0/502710728 >> v2:172.21.15.89:3300/0 conn(0x7f60c00bc600 0x7f60c00b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60bffff640 1 -- 172.21.15.89:0/502710728 >> v2:172.21.15.121:3300/0 conn(0x7f60c00b66d0 msgr2=0x7f60c0144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60bffff640 1 --2- 172.21.15.89:0/502710728 >> v2:172.21.15.121:3300/0 conn(0x7f60c00b66d0 0x7f60c0144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60bffff640 1 -- 172.21.15.89:0/502710728 >> v1:172.21.15.89:6789/0 conn(0x7f60c00b5470 legacy=0x7f60c014af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60bf7fe640 1 -- 172.21.15.89:0/502710728 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234645673 0 0) 0x7f60c00b6c20 con 0x7f60c00b5470 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.068+0000 7f60bffff640 1 -- 172.21.15.89:0/502710728 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c014a730 con 0x7f60c00bc600 2023-08-25T09:42:34.347 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.069+0000 7f60bffff640 1 --2- 172.21.15.89:0/502710728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00bc600 0x7f60c00b5850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f60c006c960 tx=0x7f60b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e7e04270cb31ac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.069+0000 7f60bf7fe640 1 -- 172.21.15.89:0/502710728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b402e070 con 0x7f60c00bc600 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.069+0000 7f60bf7fe640 1 -- 172.21.15.89:0/502710728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b40315a0 con 0x7f60c00bc600 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.069+0000 7f60bf7fe640 1 -- 172.21.15.89:0/502710728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4031930 con 0x7f60c00bc600 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 -- 172.21.15.89:0/502710728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00bc600 msgr2=0x7f60c00b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 --2- 172.21.15.89:0/502710728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00bc600 0x7f60c00b5850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f60c006c960 tx=0x7f60b402b840 comp rx=0 tx=0).stop 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 -- 172.21.15.89:0/502710728 shutdown_connections 2023-08-25T09:42:34.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 --2- 172.21.15.89:0/502710728 >> v2:172.21.15.121:3300/0 conn(0x7f60c00b66d0 0x7f60c0144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 --2- 172.21.15.89:0/502710728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00bc600 0x7f60c00b5850 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 -- 172.21.15.89:0/502710728 >> 172.21.15.89:0/502710728 conn(0x7f60c00bcb10 msgr2=0x7f60c00bcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 -- 172.21.15.89:0/502710728 shutdown_connections 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.070+0000 7f60c5da2640 1 -- 172.21.15.89:0/502710728 wait complete. 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.071+0000 7f60c5da2640 1 Processor -- start 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.071+0000 7f60c5da2640 1 -- start start 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60c00b5470 0x7f60c0142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:34.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 0x7f60c01e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c00bc600 0x7f60c01e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0143480 con 0x7f60c00b66d0 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00b8af0 con 0x7f60c00bc600 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01e0430 con 0x7f60c00b5470 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 0x7f60c01e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 0x7f60c01e2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52970/0 (socket says 172.21.15.89:52970) 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 -- 172.21.15.89:0/1719902079 learned_addr learned my addr 172.21.15.89:0/1719902079 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:34.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c55a1640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c00bc600 0x7f60c01e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c4da0640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60c00b5470 0x7f60c0142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 -- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60c00b5470 msgr2=0x7f60c0142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60c00b5470 0x7f60c0142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 -- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c00bc600 msgr2=0x7f60c01e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c00bc600 0x7f60c01e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 -- 172.21.15.89:0/1719902079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009400 con 0x7f60c00b66d0 2023-08-25T09:42:34.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bffff640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 0x7f60c01e2dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f60b4034040 tx=0x7f60b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4004230 con 0x7f60c00b66d0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4004390 con 0x7f60c00b66d0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c00bab90 con 0x7f60c00b66d0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4032860 con 0x7f60c00b66d0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.072+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c01dfe70 con 0x7f60c00b66d0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.073+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c01e2ae0 con 0x7f60c00b66d0 2023-08-25T09:42:34.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.074+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60b40329c0 con 0x7f60c00b66d0 2023-08-25T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.074+0000 7f60bd7fa640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f60ac06a050 0x7f60ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.074+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f60b40aa590 con 0x7f60c00b66d0 2023-08-25T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.074+0000 7f60c4da0640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f60ac06a050 0x7f60ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.075+0000 7f60c4da0640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f60ac06a050 0x7f60ac06c510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f60b0000f60 tx=0x7f60b0007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.078+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f60c01e2ae0 con 0x7f60c00b66d0 2023-08-25T09:42:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.246+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60c01e2ae0 con 0x7f60c00b66d0 2023-08-25T09:42:34.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.908+0000 7f60bd7fa640 1 -- 172.21.15.89:0/1719902079 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f60c01e2ae0 con 0x7f60c00b66d0 2023-08-25T09:42:34.910 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2023-08-25T09:42:34.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f60ac06a050 msgr2=0x7f60ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:34.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f60ac06a050 0x7f60ac06c510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f60b0000f60 tx=0x7f60b0007d50 comp rx=0 tx=0).stop 2023-08-25T09:42:34.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 msgr2=0x7f60c01e2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:34.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 0x7f60c01e2dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f60b4034040 tx=0x7f60b40046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 shutdown_connections 2023-08-25T09:42:34.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f60ac06a050 0x7f60ac06c510 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c00b66d0 0x7f60c01e2dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c00bc600 0x7f60c01e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 --2- 172.21.15.89:0/1719902079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60c00b5470 0x7f60c0142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:34.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 >> 172.21.15.89:0/1719902079 conn(0x7f60c00bcb10 msgr2=0x7f60c00bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:34.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 shutdown_connections 2023-08-25T09:42:34.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:34.911+0000 7f60c5da2640 1 -- 172.21.15.89:0/1719902079 wait complete. 2023-08-25T09:42:34.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T09:42:35.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.025+0000 7fbb679b5640 1 Processor -- start 2023-08-25T09:42:35.027 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.025+0000 7fbb679b5640 1 -- start start 2023-08-25T09:42:35.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb679b5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb600a54b0 0x7fbb600a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb679b5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 0x7fbb60155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb679b5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb600bc460 con 0x7fbb600bae10 2023-08-25T09:42:35.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb679b5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6006abd0 con 0x7fbb600a54b0 2023-08-25T09:42:35.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb679b5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6006a8f0 con 0x7fbb601533a0 2023-08-25T09:42:35.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb65751640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbb600bae10 0x7fbb6014ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60038/0 (socket says 172.21.15.89:60038) 2023-08-25T09:42:35.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb65751640 1 -- 172.21.15.89:0/1413731772 learned_addr learned my addr 172.21.15.89:0/1413731772 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:35.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250231302 0 0) 0x7fbb600bc460 con 0x7fbb600bae10 2023-08-25T09:42:35.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.026+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb4c003520 con 0x7fbb600bae10 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 0x7fbb60155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb64f50640 1 --2- 172.21.15.89:0/1413731772 >> v2:172.21.15.121:3300/0 conn(0x7fbb600a54b0 0x7fbb600a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1498211892 0 0) 0x7fbb4c003520 con 0x7fbb600bae10 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 msgr2=0x7fbb60155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 0x7fbb60155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 >> v2:172.21.15.121:3300/0 conn(0x7fbb600a54b0 msgr2=0x7fbb600a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:35.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 --2- 172.21.15.89:0/1413731772 >> v2:172.21.15.121:3300/0 conn(0x7fbb600a54b0 0x7fbb600a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6006a4b0 con 0x7fbb600bae10 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fbb5c001670 con 0x7fbb600bae10 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 >> v1:172.21.15.89:6789/0 conn(0x7fbb600bae10 legacy=0x7fbb6014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb4c003970 0x7fbb4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 0x7fbb4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6006abd0 con 0x7fbb4c004d00 2023-08-25T09:42:35.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6006a8f0 con 0x7fbb4c003970 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c00b980 con 0x7fbb601533a0 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65751640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb4c003970 0x7fbb4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb64f50640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 0x7fbb4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 -- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 msgr2=0x7fbb4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb601533a0 0x7fbb4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 -- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb4c003970 msgr2=0x7fbb4c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:35.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb4c003970 0x7fbb4c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.027+0000 7fbb65f52640 1 -- 172.21.15.89:0/1413731772 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c003520 con 0x7fbb4c004d00 2023-08-25T09:42:35.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.028+0000 7fbb65f52640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb4c005180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009f90 tx=0x7fbb4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb8ae6404a2002e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:35.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.028+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5802cbd0 con 0x7fbb4c004d00 2023-08-25T09:42:35.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.028+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800f040 con 0x7fbb4c004d00 2023-08-25T09:42:35.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.028+0000 7fbb57fff640 1 -- 172.21.15.89:0/1413731772 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58034440 con 0x7fbb4c004d00 2023-08-25T09:42:35.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb679b5640 1 -- 172.21.15.89:0/1413731772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 msgr2=0x7fbb4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:35.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb679b5640 1 --2- 172.21.15.89:0/1413731772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb4c005180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009f90 tx=0x7fbb4c0057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb65f52640 1 -- 172.21.15.89:0/1413731772 reap_dead start 2023-08-25T09:42:35.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb679b5640 1 -- 172.21.15.89:0/1413731772 shutdown_connections 2023-08-25T09:42:35.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb679b5640 1 -- 172.21.15.89:0/1413731772 >> 172.21.15.89:0/1413731772 conn(0x7fbb600c0220 msgr2=0x7fbb600c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:35.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb679b5640 1 -- 172.21.15.89:0/1413731772 shutdown_connections 2023-08-25T09:42:35.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.029+0000 7fbb679b5640 1 -- 172.21.15.89:0/1413731772 wait complete. 2023-08-25T09:42:35.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 Processor -- start 2023-08-25T09:42:35.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 -- start start 2023-08-25T09:42:35.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb600b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb601df6e0 0x7fbb60145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb600b54c0 0x7fbb600b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6009f540 con 0x7fbb4c004d00 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb601dfc50 con 0x7fbb601df6e0 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb679b5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb601dff30 con 0x7fbb600b54c0 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb65751640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb600b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb65751640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb600b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52990/0 (socket says 172.21.15.89:52990) 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb65751640 1 -- 172.21.15.89:0/3271395062 learned_addr learned my addr 172.21.15.89:0/3271395062 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb65f52640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb600b54c0 0x7fbb600b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.030+0000 7fbb64f50640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb601df6e0 0x7fbb60145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb65751640 1 -- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb600b54c0 msgr2=0x7fbb600b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb65751640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb600b54c0 0x7fbb600b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb65751640 1 -- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb601df6e0 msgr2=0x7fbb60145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:35.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb65751640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb601df6e0 0x7fbb60145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb65751640 1 -- 172.21.15.89:0/3271395062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb601e0210 con 0x7fbb4c004d00 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb64f50640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb601df6e0 0x7fbb60145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb65751640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb600b6b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c007310 tx=0x7fbb5c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c00f9c0 con 0x7fbb4c004d00 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c00fb40 con 0x7fbb4c004d00 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0133f0 con 0x7fbb4c004d00 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb601e04f0 con 0x7fbb4c004d00 2023-08-25T09:42:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.031+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb600b5970 con 0x7fbb4c004d00 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.032+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb600b6780 con 0x7fbb4c004d00 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.032+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb5c013550 con 0x7fbb4c004d00 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.033+0000 7fbb55ffb640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb4406a080 0x7fbb4406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.033+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fbb5c0884c0 con 0x7fbb4c004d00 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.033+0000 7fbb64f50640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb4406a080 0x7fbb4406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.033+0000 7fbb64f50640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb4406a080 0x7fbb4406c540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbb600bcb30 tx=0x7fbb50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.037+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbb600b6780 con 0x7fbb4c004d00 2023-08-25T09:42:35.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.204+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb600b6780 con 0x7fbb4c004d00 2023-08-25T09:42:35.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.909+0000 7fbb55ffb640 1 -- 172.21.15.89:0/3271395062 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbb600b6780 con 0x7fbb4c004d00 2023-08-25T09:42:35.911 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2023-08-25T09:42:35.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb4406a080 msgr2=0x7fbb4406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:35.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb4406a080 0x7fbb4406c540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbb600bcb30 tx=0x7fbb50008040 comp rx=0 tx=0).stop 2023-08-25T09:42:35.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 msgr2=0x7fbb600b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb600b6b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c007310 tx=0x7fbb5c0077d0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 shutdown_connections 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fbb4406a080 0x7fbb4406c540 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb600b54c0 0x7fbb600b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb601df6e0 0x7fbb60145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 --2- 172.21.15.89:0/3271395062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb4c004d00 0x7fbb600b6b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:35.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.912+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 >> 172.21.15.89:0/3271395062 conn(0x7fbb600c0220 msgr2=0x7fbb600be000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.913+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 shutdown_connections 2023-08-25T09:42:35.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:35.913+0000 7fbb679b5640 1 -- 172.21.15.89:0/3271395062 wait complete. 2023-08-25T09:42:35.926 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T09:42:35.926 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T09:42:35.927 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T09:42:35.927 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T09:42:35.927 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T09:42:35.927 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T09:42:35.928 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T09:42:35.928 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T09:42:35.928 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T09:42:35.928 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T09:42:35.929 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T09:42:35.929 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T09:42:35.937 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T09:42:35.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T09:42:35.938 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T09:42:35.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T09:42:35.939 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T09:42:35.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T09:42:35.980 INFO:tasks.ceph.mds.a:Started 2023-08-25T09:42:35.980 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:35.981 INFO:tasks.ceph.mds.c:Started 2023-08-25T09:42:35.982 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:35.982 INFO:tasks.ceph.mds.b:Started 2023-08-25T09:42:35.983 DEBUG:teuthology.parallel:result is None 2023-08-25T09:42:35.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T09:42:36.055 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2023-08-25T09:42:36.056 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2023-08-25T09:42:36.062 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2023-08-25T09:42:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.086+0000 7f99c38ec640 1 Processor -- start 2023-08-25T09:42:36.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.086+0000 7f99c38ec640 1 -- start start 2023-08-25T09:42:36.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.086+0000 7f99c38ec640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f99bc0b7c10 0x7f99bc070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:36.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.086+0000 7f99c38ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b3040 con 0x7f99bc06fb00 2023-08-25T09:42:36.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c38ec640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b27a0 con 0x7f99bc070fd0 2023-08-25T09:42:36.089 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c38ec640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0b2a80 con 0x7f99bc0b7c10 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c1e89640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f99bc06fb00 0x7f99bc151f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57624/0 (socket says 172.21.15.89:57624) 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c1e89640 1 -- 172.21.15.89:0/1424344140 learned_addr learned my addr 172.21.15.89:0/1424344140 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c1688640 1 --2- 172.21.15.89:0/1424344140 >> v2:172.21.15.121:3300/0 conn(0x7f99bc0b7c10 0x7f99bc070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99b3fff640 1 -- 172.21.15.89:0/1424344140 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749592982 0 0) 0x7f99bc0b3040 con 0x7f99bc06fb00 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99b3fff640 1 -- 172.21.15.89:0/1424344140 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a8003520 con 0x7f99bc06fb00 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c1688640 1 -- 172.21.15.89:0/1424344140 >> v1:172.21.15.121:6789/0 conn(0x7f99bc070fd0 legacy=0x7f99bc141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99b3fff640 1 -- 172.21.15.89:0/1424344140 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46302399 0 0) 0x7f99bc0b27a0 con 0x7f99bc070fd0 2023-08-25T09:42:36.090 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c1688640 1 -- 172.21.15.89:0/1424344140 >> v1:172.21.15.89:6789/0 conn(0x7f99bc06fb00 legacy=0x7f99bc151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.087+0000 7f99c1688640 1 -- 172.21.15.89:0/1424344140 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0b2d60 con 0x7f99bc0b7c10 2023-08-25T09:42:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99c1688640 1 --2- 172.21.15.89:0/1424344140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc0b7c10 0x7f99bc070a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f99b80097a0 tx=0x7f99b802b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44da7addb444f07 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:36.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99b3fff640 1 -- 172.21.15.89:0/1424344140 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40019f0 con 0x7f99bc0b7c10 2023-08-25T09:42:36.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99b3fff640 1 -- 172.21.15.89:0/1424344140 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b802e050 con 0x7f99bc0b7c10 2023-08-25T09:42:36.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99b3fff640 1 -- 172.21.15.89:0/1424344140 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8030730 con 0x7f99bc0b7c10 2023-08-25T09:42:36.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99c38ec640 1 -- 172.21.15.89:0/1424344140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc0b7c10 msgr2=0x7f99bc070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:36.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99c38ec640 1 --2- 172.21.15.89:0/1424344140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc0b7c10 0x7f99bc070a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f99b80097a0 tx=0x7f99b802b7d0 comp rx=0 tx=0).stop 2023-08-25T09:42:36.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99c38ec640 1 -- 172.21.15.89:0/1424344140 shutdown_connections 2023-08-25T09:42:36.094 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99c38ec640 1 --2- 172.21.15.89:0/1424344140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc0b7c10 0x7f99bc070a90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.088+0000 7f99c38ec640 1 -- 172.21.15.89:0/1424344140 >> 172.21.15.89:0/1424344140 conn(0x7f99bc069a30 msgr2=0x7f99bc069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.089+0000 7f99c38ec640 1 -- 172.21.15.89:0/1424344140 shutdown_connections 2023-08-25T09:42:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.089+0000 7f99c38ec640 1 -- 172.21.15.89:0/1424344140 wait complete. 2023-08-25T09:42:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 Processor -- start 2023-08-25T09:42:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 -- start start 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc06fb00 0x7f99bc13ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 0x7f99bc0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99bc0b7c10 0x7f99bc0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc13f100 con 0x7f99bc070fd0 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc147650 con 0x7f99bc06fb00 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c38ec640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b59a0 con 0x7f99bc0b7c10 2023-08-25T09:42:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c0e87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 0x7f99bc0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:36.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c0e87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 0x7f99bc0b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55440/0 (socket says 172.21.15.89:55440) 2023-08-25T09:42:36.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c0e87640 1 -- 172.21.15.89:0/2668963553 learned_addr learned my addr 172.21.15.89:0/2668963553 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:36.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c1e89640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99bc0b7c10 0x7f99bc0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:36.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c1688640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc06fb00 0x7f99bc13ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:36.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c0e87640 1 -- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99bc0b7c10 msgr2=0x7f99bc0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:36.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.090+0000 7f99c0e87640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99bc0b7c10 0x7f99bc0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c0e87640 1 -- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc06fb00 msgr2=0x7f99bc13ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c0e87640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc06fb00 0x7f99bc13ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c0e87640 1 -- 172.21.15.89:0/2668963553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009400 con 0x7f99bc070fd0 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c1e89640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99bc0b7c10 0x7f99bc0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c1688640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc06fb00 0x7f99bc13ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c0e87640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 0x7f99bc0b5460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c4e0 tx=0x7f99ac00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac005480 con 0x7f99bc070fd0 2023-08-25T09:42:36.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0035f0 con 0x7f99bc070fd0 2023-08-25T09:42:36.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0b5c60 con 0x7f99bc070fd0 2023-08-25T09:42:36.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0039c0 con 0x7f99bc070fd0 2023-08-25T09:42:36.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.091+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc147e80 con 0x7f99bc070fd0 2023-08-25T09:42:36.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.092+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc073bf0 con 0x7f99bc070fd0 2023-08-25T09:42:36.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.092+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f99ac003b20 con 0x7f99bc070fd0 2023-08-25T09:42:36.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.093+0000 7f99b1ffb640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f99a006a080 0x7f99a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:36.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.093+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f99ac087700 con 0x7f99bc070fd0 2023-08-25T09:42:36.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.093+0000 7f99c1688640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f99a006a080 0x7f99a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:36.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.093+0000 7f99c1688640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f99a006a080 0x7f99a006c540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06cdc0 tx=0x7f99b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:36.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.097+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f99ac053110 con 0x7f99bc070fd0 2023-08-25T09:42:36.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:36.283+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f99bc06ed90 con 0x7f99bc070fd0 2023-08-25T09:42:37.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.272+0000 7f99b1ffb640 1 -- 172.21.15.89:0/2668963553 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f99ac017070 con 0x7f99bc070fd0 2023-08-25T09:42:37.274 INFO:teuthology.orchestra.run.smithi089.stderr: removed all blocklist entries 2023-08-25T09:42:37.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f99a006a080 msgr2=0x7f99a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f99a006a080 0x7f99a006c540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06cdc0 tx=0x7f99b8008030 comp rx=0 tx=0).stop 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 msgr2=0x7f99bc0b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 0x7f99bc0b5460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c4e0 tx=0x7f99ac00c9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 shutdown_connections 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f99a006a080 0x7f99a006c540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99bc070fd0 0x7f99bc0b5460 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99bc0b7c10 0x7f99bc0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 --2- 172.21.15.89:0/2668963553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99bc06fb00 0x7f99bc13ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 >> 172.21.15.89:0/2668963553 conn(0x7f99bc069a30 msgr2=0x7f99bc13d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:37.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 shutdown_connections 2023-08-25T09:42:37.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.275+0000 7f99c38ec640 1 -- 172.21.15.89:0/2668963553 wait complete. 2023-08-25T09:42:37.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T09:42:37.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.388+0000 7fcd29c71640 1 Processor -- start 2023-08-25T09:42:37.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.388+0000 7fcd29c71640 1 -- start start 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd29c71640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd24144c40 0x7fcd240bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd29c71640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd240b6ec0 0x7fcd240b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd29c71640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd24145020 con 0x7fcd2414ddb0 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd29c71640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd240b9330 con 0x7fcd24144c40 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd29c71640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd240bd290 con 0x7fcd240b6ec0 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd24144c40 0x7fcd240bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd24144c40 0x7fcd240bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55452/0 (socket says 172.21.15.89:55452) 2023-08-25T09:42:37.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 -- 172.21.15.89:0/1437017021 learned_addr learned my addr 172.21.15.89:0/1437017021 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:37.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd23fff640 1 --1- 172.21.15.89:0/1437017021 >> v1:172.21.15.89:6789/0 conn(0x7fcd2414ddb0 0x7fcd240babe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57626/0 (socket says 172.21.15.89:57626) 2023-08-25T09:42:37.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd1affd640 1 --2- 172.21.15.89:0/1437017021 >> v2:172.21.15.121:3300/0 conn(0x7fcd240b6ec0 0x7fcd240b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 -- 172.21.15.89:0/1437017021 >> v2:172.21.15.121:3300/0 conn(0x7fcd240b6ec0 msgr2=0x7fcd240b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:37.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 --2- 172.21.15.89:0/1437017021 >> v2:172.21.15.121:3300/0 conn(0x7fcd240b6ec0 0x7fcd240b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 -- 172.21.15.89:0/1437017021 >> v1:172.21.15.89:6789/0 conn(0x7fcd2414ddb0 legacy=0x7fcd240babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd22ffd640 1 -- 172.21.15.89:0/1437017021 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177021660 0 0) 0x7fcd24145020 con 0x7fcd2414ddb0 2023-08-25T09:42:37.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.389+0000 7fcd237fe640 1 -- 172.21.15.89:0/1437017021 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240b8850 con 0x7fcd24144c40 2023-08-25T09:42:37.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.390+0000 7fcd237fe640 1 --2- 172.21.15.89:0/1437017021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd24144c40 0x7fcd240bcc70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd24148470 tx=0x7fcd1402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e586103df314297e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:37.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.390+0000 7fcd22ffd640 1 -- 172.21.15.89:0/1437017021 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14030860 con 0x7fcd24144c40 2023-08-25T09:42:37.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.390+0000 7fcd22ffd640 1 -- 172.21.15.89:0/1437017021 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd140309c0 con 0x7fcd24144c40 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.390+0000 7fcd22ffd640 1 -- 172.21.15.89:0/1437017021 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14030d50 con 0x7fcd24144c40 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 -- 172.21.15.89:0/1437017021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd24144c40 msgr2=0x7fcd240bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1437017021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd24144c40 0x7fcd240bcc70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd24148470 tx=0x7fcd1402b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 -- 172.21.15.89:0/1437017021 shutdown_connections 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1437017021 >> v2:172.21.15.121:3300/0 conn(0x7fcd240b6ec0 0x7fcd240b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1437017021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd24144c40 0x7fcd240bcc70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 -- 172.21.15.89:0/1437017021 >> 172.21.15.89:0/1437017021 conn(0x7fcd240654f0 msgr2=0x7fcd240658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 -- 172.21.15.89:0/1437017021 shutdown_connections 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.391+0000 7fcd29c71640 1 -- 172.21.15.89:0/1437017021 wait complete. 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.392+0000 7fcd29c71640 1 Processor -- start 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.392+0000 7fcd29c71640 1 -- start start 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 0x7fcd240b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd24144c40 0x7fcd241dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd2414ddb0 0x7fcd241e03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240b6b70 con 0x7fcd240b6ec0 2023-08-25T09:42:37.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240b5ec0 con 0x7fcd2414ddb0 2023-08-25T09:42:37.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241e36e0 con 0x7fcd24144c40 2023-08-25T09:42:37.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 0x7fcd240b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 0x7fcd240b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55460/0 (socket says 172.21.15.89:55460) 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 -- 172.21.15.89:0/1232606911 learned_addr learned my addr 172.21.15.89:0/1232606911 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd1affd640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd24144c40 0x7fcd241dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd23fff640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd2414ddb0 0x7fcd241e03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 -- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd24144c40 msgr2=0x7fcd241dfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd24144c40 0x7fcd241dfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 -- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd2414ddb0 msgr2=0x7fcd241e03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd2414ddb0 0x7fcd241e03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 -- 172.21.15.89:0/1232606911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140094d0 con 0x7fcd240b6ec0 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd1affd640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd24144c40 0x7fcd241dfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd237fe640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 0x7fcd240b6630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd14000c00 tx=0x7fcd14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14039c90 con 0x7fcd240b6ec0 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd14039df0 con 0x7fcd240b6ec0 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd241e39c0 con 0x7fcd240b6ec0 2023-08-25T09:42:37.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14043620 con 0x7fcd240b6ec0 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.393+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd241df990 con 0x7fcd240b6ec0 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.394+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd24073bf0 con 0x7fcd240b6ec0 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.395+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd14043780 con 0x7fcd240b6ec0 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.395+0000 7fcd20ff9640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcd0406a050 0x7fcd0406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.395+0000 7fcd1affd640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcd0406a050 0x7fcd0406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.395+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcd1403e070 con 0x7fcd240b6ec0 2023-08-25T09:42:37.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.396+0000 7fcd1affd640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcd0406a050 0x7fcd0406c510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd24142ad0 tx=0x7fcd0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:37.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.399+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd14076e10 con 0x7fcd240b6ec0 2023-08-25T09:42:37.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.626+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcd240bc3d0 con 0x7fcd240b6ec0 2023-08-25T09:42:37.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.627+0000 7fcd20ff9640 1 -- 172.21.15.89:0/1232606911 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7fcd1407a430 con 0x7fcd240b6ec0 2023-08-25T09:42:37.630 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:37.631 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-08-25T09:42:37.631 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_dump": [ 2023-08-25T09:42:37.631 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.632 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.a", 2023-08-25T09:42:37.632 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAvd+hklWpRBBAALBGH8HDScvn2SIxoJFffIw==", 2023-08-25T09:42:37.632 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.633 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-08-25T09:42:37.633 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-08-25T09:42:37.633 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-08-25T09:42:37.633 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.633 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.634 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.634 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.634 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.b", 2023-08-25T09:42:37.635 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAvd+hk+2aCERAAHEuatK/IsLr4hmgzMWP9ig==", 2023-08-25T09:42:37.635 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.635 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-08-25T09:42:37.635 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-08-25T09:42:37.636 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-08-25T09:42:37.636 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.636 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.637 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.637 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.637 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mds.c", 2023-08-25T09:42:37.638 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAvd+hk2YHmCxAAPEWEfQXOA9Pe8hu3GW0o7Q==", 2023-08-25T09:42:37.638 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.638 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-08-25T09:42:37.639 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-08-25T09:42:37.639 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-08-25T09:42:37.639 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.639 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.640 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.640 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.640 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.0", 2023-08-25T09:42:37.641 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAyd+hkZxrLLhAADuCjEkTSiFApavGK3Lo+jw==", 2023-08-25T09:42:37.641 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.641 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.642 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.642 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.642 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.642 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.642 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.642 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.1", 2023-08-25T09:42:37.643 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA1d+hkrSXjLBAADzsti2P+PLGx2ZgMGOu85g==", 2023-08-25T09:42:37.643 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.643 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.644 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.644 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.644 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.644 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.645 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.645 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.2", 2023-08-25T09:42:37.645 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA4d+hkB0I9KxAA+JFDCE2XqTP6B8GGQpiw2w==", 2023-08-25T09:42:37.645 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.646 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.646 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.646 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.647 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.648 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.650 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.650 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.3", 2023-08-25T09:42:37.650 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQA7d+hkyFj/KRAAETTB4JI7dOxF7jMuNV5SyA==", 2023-08-25T09:42:37.650 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.650 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.650 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.651 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.651 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.651 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.651 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.652 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.4", 2023-08-25T09:42:37.652 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBBd+hkMLZaNBAA8knQnzlTYWHWnVuzkGjIIg==", 2023-08-25T09:42:37.652 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.652 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.653 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.653 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.653 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.653 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.653 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.654 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.5", 2023-08-25T09:42:37.654 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBEd+hkGA/RMhAAPR0YJQB7qqcotuDmpjsRIA==", 2023-08-25T09:42:37.654 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.654 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.655 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.656 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.656 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.657 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.657 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.657 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.6", 2023-08-25T09:42:37.657 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBHd+hkxkj+MBAAspeQkYZhfIp1bR3xDPI2vg==", 2023-08-25T09:42:37.658 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.658 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.658 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.658 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.658 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.658 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.659 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.659 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "osd.7", 2023-08-25T09:42:37.659 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBKd+hkkcNrLxAAMtlRn9YWXHrEDjkIBb9rHg==", 2023-08-25T09:42:37.659 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.660 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow profile osd", 2023-08-25T09:42:37.660 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile osd", 2023-08-25T09:42:37.660 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.660 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.660 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.660 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.0", 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAvd+hkle7ZGxAAQN9Z+CBij65mSNnJP4/B3g==", 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow", 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow r", 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow rw", 2023-08-25T09:42:37.661 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow rwx" 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.admin", 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAud+hkcLwgExAACDhMTse7FXgXw35v69zYKw==", 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-08-25T09:42:37.662 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": "allow *", 2023-08-25T09:42:37.663 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow *", 2023-08-25T09:42:37.663 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.663 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.663 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.663 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.663 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-mds", 2023-08-25T09:42:37.664 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBQd+hkJaIJHRAACNXBzbbBtQjpWldsY2FZ6A==", 2023-08-25T09:42:37.664 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.664 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-mds" 2023-08-25T09:42:37.664 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.665 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.665 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.665 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-mgr", 2023-08-25T09:42:37.665 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBQd+hkiKkJHRAA7RUaQ+p6xGCM33BR5Z+HeQ==", 2023-08-25T09:42:37.665 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.666 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-25T09:42:37.666 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.666 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.667 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.667 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-osd", 2023-08-25T09:42:37.667 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBQd+hkd7EJHRAA0eHPMbGDv8TySHMMURxgiA==", 2023-08-25T09:42:37.668 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.668 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-osd" 2023-08-25T09:42:37.668 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.669 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.669 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.669 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-rbd", 2023-08-25T09:42:37.670 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBQd+hk7LcJHRAATKsXUNUt3+GCxX1xpystag==", 2023-08-25T09:42:37.670 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.670 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-25T09:42:37.670 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.671 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.671 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.671 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-25T09:42:37.671 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBQd+hkaL4JHRAADkCVS9jDkUKgnG3u3LGztQ==", 2023-08-25T09:42:37.672 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.672 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-25T09:42:37.673 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.673 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.673 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "client.bootstrap-rgw", 2023-08-25T09:42:37.674 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQBQd+hkLsUJHRAAk+OEPeaKZ0wHMYHoUPwrWQ==", 2023-08-25T09:42:37.675 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.675 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-25T09:42:37.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.676 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.676 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.x", 2023-08-25T09:42:37.677 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAvd+hk6TjgABAA+ZkeOb3zGhPR8sI58e7rSQ==", 2023-08-25T09:42:37.677 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.677 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-08-25T09:42:37.677 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-08-25T09:42:37.678 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.679 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.679 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:37.679 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:37.680 INFO:teuthology.orchestra.run.smithi089.stdout: "entity": "mgr.y", 2023-08-25T09:42:37.681 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "AQAud+hkyIRCOBAAS2vHDh1qp1cfM1j92+Mp9w==", 2023-08-25T09:42:37.681 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": { 2023-08-25T09:42:37.682 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": "allow *", 2023-08-25T09:42:37.682 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": "allow profile mgr", 2023-08-25T09:42:37.682 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": "allow *" 2023-08-25T09:42:37.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.683 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:37.683 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2023-08-25T09:42:37.683 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-08-25T09:42:37.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcd0406a050 msgr2=0x7fcd0406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcd0406a050 0x7fcd0406c510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd24142ad0 tx=0x7fcd0c008040 comp rx=0 tx=0).stop 2023-08-25T09:42:37.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 msgr2=0x7fcd240b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 0x7fcd240b6630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcd14000c00 tx=0x7fcd14004730 comp rx=0 tx=0).stop 2023-08-25T09:42:37.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 shutdown_connections 2023-08-25T09:42:37.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fcd0406a050 0x7fcd0406c510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd2414ddb0 0x7fcd241e03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd24144c40 0x7fcd241dfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 --2- 172.21.15.89:0/1232606911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd240b6ec0 0x7fcd240b6630 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.628+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 >> 172.21.15.89:0/1232606911 conn(0x7fcd240654f0 msgr2=0x7fcd2414e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:37.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.629+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 shutdown_connections 2023-08-25T09:42:37.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.629+0000 7fcd29c71640 1 -- 172.21.15.89:0/1232606911 wait complete. 2023-08-25T09:42:37.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-25T09:42:37.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.788+0000 7f9734806640 1 Processor -- start 2023-08-25T09:42:37.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f9734806640 1 -- start start 2023-08-25T09:42:37.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f9734806640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97300b3990 0x7f9730070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f9734806640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9730071980 con 0x7f9730145860 2023-08-25T09:42:37.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f9734806640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300b5390 con 0x7f97300b8990 2023-08-25T09:42:37.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f9734806640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97301463a0 con 0x7f97300b3990 2023-08-25T09:42:37.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f972e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97300b3990 0x7f9730070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f972e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97300b3990 0x7f9730070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55474/0 (socket says 172.21.15.89:55474) 2023-08-25T09:42:37.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f972e59c640 1 -- 172.21.15.89:0/1557670352 learned_addr learned my addr 172.21.15.89:0/1557670352 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:37.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.789+0000 7f972ed9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9730145860 0x7f9730145c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57642/0 (socket says 172.21.15.89:57642) 2023-08-25T09:42:37.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972e59c640 1 -- 172.21.15.89:0/1557670352 >> v1:172.21.15.121:6789/0 conn(0x7f97300b8990 legacy=0x7f9730148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:37.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972e59c640 1 -- 172.21.15.89:0/1557670352 >> v1:172.21.15.89:6789/0 conn(0x7f9730145860 legacy=0x7f9730145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972e59c640 1 -- 172.21.15.89:0/1557670352 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300713c0 con 0x7f97300b3990 2023-08-25T09:42:37.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972dd9b640 1 -- 172.21.15.89:0/1557670352 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783703123 0 0) 0x7f9730071980 con 0x7f9730145860 2023-08-25T09:42:37.799 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972e59c640 1 --2- 172.21.15.89:0/1557670352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f9730070d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9720009870 tx=0x7f972002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66afab399369a9f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:37.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972dd9b640 1 -- 172.21.15.89:0/1557670352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720030860 con 0x7f97300b3990 2023-08-25T09:42:37.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.790+0000 7f972dd9b640 1 -- 172.21.15.89:0/1557670352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200309c0 con 0x7f97300b3990 2023-08-25T09:42:37.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f972dd9b640 1 -- 172.21.15.89:0/1557670352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720030d50 con 0x7f97300b3990 2023-08-25T09:42:37.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 -- 172.21.15.89:0/1557670352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 msgr2=0x7f9730070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 --2- 172.21.15.89:0/1557670352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f9730070d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9720009870 tx=0x7f972002b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 -- 172.21.15.89:0/1557670352 shutdown_connections 2023-08-25T09:42:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 --2- 172.21.15.89:0/1557670352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f9730070d10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 -- 172.21.15.89:0/1557670352 >> 172.21.15.89:0/1557670352 conn(0x7f97300bc320 msgr2=0x7f97300bc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:37.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 -- 172.21.15.89:0/1557670352 shutdown_connections 2023-08-25T09:42:37.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.791+0000 7f9734806640 1 -- 172.21.15.89:0/1557670352 wait complete. 2023-08-25T09:42:37.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.792+0000 7f9734806640 1 Processor -- start 2023-08-25T09:42:37.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.792+0000 7f9734806640 1 -- start start 2023-08-25T09:42:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9734806640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f97301479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9734806640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97300b8990 0x7f97300b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9734806640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9730145860 0x7f97300ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9734806640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300aa600 con 0x7f97300b3990 2023-08-25T09:42:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9734806640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b2380 con 0x7f9730145860 2023-08-25T09:42:37.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9734806640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300ab670 con 0x7f97300b8990 2023-08-25T09:42:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f97301479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f97301479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55490/0 (socket says 172.21.15.89:55490) 2023-08-25T09:42:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 -- 172.21.15.89:0/1996719252 learned_addr learned my addr 172.21.15.89:0/1996719252 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f9727fff640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97300b8990 0x7f97300b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 -- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97300b8990 msgr2=0x7f97300b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97300b8990 0x7f97300b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 -- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9730145860 msgr2=0x7f97300ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972ed9d640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9730145860 0x7f97300ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9730145860 0x7f97300ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 -- 172.21.15.89:0/1996719252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97200094d0 con 0x7f97300b3990 2023-08-25T09:42:37.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.793+0000 7f972e59c640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f97301479e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9720009870 tx=0x7f9720004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.794+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972003e040 con 0x7f97300b3990 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.794+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9720039d80 con 0x7f97300b3990 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.794+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97300a9cf0 con 0x7f97300b3990 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.794+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720004270 con 0x7f97300b3990 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.794+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300a9f40 con 0x7f97300b3990 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.795+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97300aa740 con 0x7f97300b3990 2023-08-25T09:42:37.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.795+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f97200043d0 con 0x7f97300b3990 2023-08-25T09:42:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.795+0000 7f9726ffd640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f971006a050 0x7f971006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.795+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f97200aaa70 con 0x7f97300b3990 2023-08-25T09:42:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.795+0000 7f9727fff640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f971006a050 0x7f971006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.796+0000 7f9727fff640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f971006a050 0x7f971006c510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97301de360 tx=0x7f9718009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:37.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:37.800+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9720076660 con 0x7f97300b3990 2023-08-25T09:42:38.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.029+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9730073bf0 con 0x7f97300b3990 2023-08-25T09:42:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.034+0000 7f9726ffd640 1 -- 172.21.15.89:0/1996719252 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f97200340a0 con 0x7f97300b3990 2023-08-25T09:42:38.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f971006a050 msgr2=0x7f971006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f971006a050 0x7f971006c510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97301de360 tx=0x7f9718009040 comp rx=0 tx=0).stop 2023-08-25T09:42:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 msgr2=0x7f97301479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f97301479e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9720009870 tx=0x7f9720004730 comp rx=0 tx=0).stop 2023-08-25T09:42:38.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 shutdown_connections 2023-08-25T09:42:38.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f971006a050 0x7f971006c510 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9730145860 0x7f97300ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97300b8990 0x7f97300b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 --2- 172.21.15.89:0/1996719252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97300b3990 0x7f97301479e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.036+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 >> 172.21.15.89:0/1996719252 conn(0x7f97300bc320 msgr2=0x7f9730143960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:38.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.037+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 shutdown_connections 2023-08-25T09:42:38.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.037+0000 7f9734806640 1 -- 172.21.15.89:0/1996719252 wait complete. 2023-08-25T09:42:38.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-25T09:42:38.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.147+0000 7f9adce9b640 1 Processor -- start 2023-08-25T09:42:38.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.147+0000 7f9adce9b640 1 -- start start 2023-08-25T09:42:38.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9adce9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 0x7f9ad8070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9adce9b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad8070a40 con 0x7f9ad8070120 2023-08-25T09:42:38.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9adce9b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80b3530 con 0x7f9ad8146f60 2023-08-25T09:42:38.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9adce9b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad806ec00 con 0x7f9ad80b2e20 2023-08-25T09:42:38.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9ad8070120 0x7f9ad81441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57652/0 (socket says 172.21.15.89:57652) 2023-08-25T09:42:38.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad659c640 1 -- 172.21.15.89:0/52731637 learned_addr learned my addr 172.21.15.89:0/52731637 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:38.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355406586 0 0) 0x7f9ac8001110 con 0x7f9ad8070120 2023-08-25T09:42:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad6d9d640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 0x7f9ad8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac4004630 con 0x7f9ad8070120 2023-08-25T09:42:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104877525 0 0) 0x7f9ac4004630 con 0x7f9ad8070120 2023-08-25T09:42:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 msgr2=0x7f9ad8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 0x7f9ad8070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 >> v1:172.21.15.121:6789/0 conn(0x7f9ad8146f60 legacy=0x7f9ad814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad806f8e0 con 0x7f9ad8070120 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f9ac8001800 con 0x7f9ad8070120 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 >> v1:172.21.15.89:6789/0 conn(0x7f9ad8070120 legacy=0x7f9ad81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac4004b20 0x7f9ac4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac40058d0 0x7f9ac4005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 0x7f9ac40062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad806ec00 con 0x7f9ac4004b20 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac400cba0 con 0x7f9ac40058d0 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac400cd60 con 0x7f9ad80b2e20 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.148+0000 7f9ad659c640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac4004b20 0x7f9ac4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9acffff640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac40058d0 0x7f9ac4005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad6d9d640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 0x7f9ac40062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad659c640 1 -- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 msgr2=0x7f9ac40062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad659c640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ad80b2e20 0x7f9ac40062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad659c640 1 -- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac40058d0 msgr2=0x7f9ac4005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad659c640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac40058d0 0x7f9ac4005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad659c640 1 -- 172.21.15.89:0/52731637 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4004630 con 0x7f9ac4004b20 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.149+0000 7f9ad659c640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac4004b20 0x7f9ac4004f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c190 tx=0x7f9ac4006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1b52a785356044 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8005ad0 con 0x7f9ac4004b20 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8005c30 con 0x7f9ac4004b20 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9ad5d9b640 1 -- 172.21.15.89:0/52731637 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac802c7e0 con 0x7f9ac4004b20 2023-08-25T09:42:38.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9adce9b640 1 -- 172.21.15.89:0/52731637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac4004b20 msgr2=0x7f9ac4004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9adce9b640 1 --2- 172.21.15.89:0/52731637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac4004b20 0x7f9ac4004f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c190 tx=0x7f9ac4006900 comp rx=0 tx=0).stop 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9ad6d9d640 1 -- 172.21.15.89:0/52731637 reap_dead start 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9adce9b640 1 -- 172.21.15.89:0/52731637 shutdown_connections 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9adce9b640 1 -- 172.21.15.89:0/52731637 >> 172.21.15.89:0/52731637 conn(0x7f9ad8069a30 msgr2=0x7f9ad8069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9adce9b640 1 -- 172.21.15.89:0/52731637 shutdown_connections 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.150+0000 7f9adce9b640 1 -- 172.21.15.89:0/52731637 wait complete. 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.151+0000 7f9adce9b640 1 Processor -- start 2023-08-25T09:42:38.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.151+0000 7f9adce9b640 1 -- start start 2023-08-25T09:42:38.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9adce9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ac4004b20 0x7f9ad813e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9adce9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad80b56e0 0x7f9ad81dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9adce9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 0x7f9ad81df2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9adce9b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad813ec90 con 0x7f9ad80b4b30 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9adce9b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad813f390 con 0x7f9ad80b56e0 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9adce9b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad813f670 con 0x7f9ac4004b20 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 0x7f9ad81df2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 0x7f9ad81df2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55502/0 (socket says 172.21.15.89:55502) 2023-08-25T09:42:38.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 -- 172.21.15.89:0/2263546317 learned_addr learned my addr 172.21.15.89:0/2263546317 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad659c640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ac4004b20 0x7f9ad813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 -- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ac4004b20 msgr2=0x7f9ad813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ac4004b20 0x7f9ad813e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 -- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad80b56e0 msgr2=0x7f9ad81dedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9acffff640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad80b56e0 0x7f9ad81dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad80b56e0 0x7f9ad81dedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 -- 172.21.15.89:0/2263546317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad813f950 con 0x7f9ad80b4b30 2023-08-25T09:42:38.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad659c640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ac4004b20 0x7f9ad813e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.152+0000 7f9ad6d9d640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 0x7f9ad81df2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806e730 tx=0x7f9ad000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.153+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000e040 con 0x7f9ad80b4b30 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.153+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad000f040 con 0x7f9ad80b4b30 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.153+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad813fc30 con 0x7f9ad80b4b30 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.153+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0015670 con 0x7f9ad80b4b30 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.153+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad813b820 con 0x7f9ad80b4b30 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.154+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad8073bf0 con 0x7f9ad80b4b30 2023-08-25T09:42:38.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.154+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ad00157d0 con 0x7f9ad80b4b30 2023-08-25T09:42:38.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.154+0000 7f9aceffd640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ab806a080 0x7f9ab806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.154+0000 7f9ad659c640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ab806a080 0x7f9ab806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.154+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9ad0088910 con 0x7f9ad80b4b30 2023-08-25T09:42:38.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.155+0000 7f9ad659c640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ab806a080 0x7f9ab806c540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8034000 tx=0x7f9ac8037040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.159+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ad0054350 con 0x7f9ad80b4b30 2023-08-25T09:42:38.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.390+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9ad80b9870 con 0x7f9ad80b4b30 2023-08-25T09:42:38.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.396+0000 7f9aceffd640 1 -- 172.21.15.89:0/2263546317 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9ad0057970 con 0x7f9ad80b4b30 2023-08-25T09:42:38.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ab806a080 msgr2=0x7f9ab806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ab806a080 0x7f9ab806c540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8034000 tx=0x7f9ac8037040 comp rx=0 tx=0).stop 2023-08-25T09:42:38.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 msgr2=0x7f9ad81df2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 0x7f9ad81df2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806e730 tx=0x7f9ad000f580 comp rx=0 tx=0).stop 2023-08-25T09:42:38.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 shutdown_connections 2023-08-25T09:42:38.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f9ab806a080 0x7f9ab806c540 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad80b4b30 0x7f9ad81df2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad80b56e0 0x7f9ad81dedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 --2- 172.21.15.89:0/2263546317 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ac4004b20 0x7f9ad813e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 >> 172.21.15.89:0/2263546317 conn(0x7f9ad8069a30 msgr2=0x7f9ad8069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:38.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 shutdown_connections 2023-08-25T09:42:38.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.398+0000 7f9adce9b640 1 -- 172.21.15.89:0/2263546317 wait complete. 2023-08-25T09:42:38.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-25T09:42:38.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.509+0000 7fe70b457640 1 Processor -- start 2023-08-25T09:42:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.509+0000 7fe70b457640 1 -- start start 2023-08-25T09:42:38.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.509+0000 7fe70b457640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe704144c40 0x7fe7040bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.509+0000 7fe70b457640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe704145020 con 0x7fe7040b6ec0 2023-08-25T09:42:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.509+0000 7fe70b457640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040b9330 con 0x7fe70414ddb0 2023-08-25T09:42:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.509+0000 7fe70b457640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040b7d70 con 0x7fe704144c40 2023-08-25T09:42:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe7089f2640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe7040b6ec0 0x7fe7040b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57664/0 (socket says 172.21.15.89:57664) 2023-08-25T09:42:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe7089f2640 1 -- 172.21.15.89:0/857924853 learned_addr learned my addr 172.21.15.89:0/857924853 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe7091f3640 1 --2- 172.21.15.89:0/857924853 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe704144c40 0x7fe7040bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe6fbfff640 1 -- 172.21.15.89:0/857924853 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851217699 0 0) 0x7fe704145020 con 0x7fe7040b6ec0 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe6fbfff640 1 -- 172.21.15.89:0/857924853 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003520 con 0x7fe7040b6ec0 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe6fbfff640 1 -- 172.21.15.89:0/857924853 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691072387 0 0) 0x7fe6f0003520 con 0x7fe7040b6ec0 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe7091f3640 1 -- 172.21.15.89:0/857924853 >> v1:172.21.15.121:6789/0 conn(0x7fe70414ddb0 legacy=0x7fe7041550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe7091f3640 1 -- 172.21.15.89:0/857924853 >> v1:172.21.15.89:6789/0 conn(0x7fe7040b6ec0 legacy=0x7fe7040b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.510+0000 7fe7091f3640 1 -- 172.21.15.89:0/857924853 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040bd290 con 0x7fe704144c40 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.511+0000 7fe7091f3640 1 --2- 172.21.15.89:0/857924853 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe704144c40 0x7fe7040bcc70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009dc0 tx=0x7fe6fc02bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7de32b0ba2db1e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.511+0000 7fe6fbfff640 1 -- 172.21.15.89:0/857924853 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4001670 con 0x7fe704144c40 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.511+0000 7fe6fbfff640 1 -- 172.21.15.89:0/857924853 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc02c910 con 0x7fe704144c40 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.511+0000 7fe6fbfff640 1 -- 172.21.15.89:0/857924853 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc02cc80 con 0x7fe704144c40 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 -- 172.21.15.89:0/857924853 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe704144c40 msgr2=0x7fe7040bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 --2- 172.21.15.89:0/857924853 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe704144c40 0x7fe7040bcc70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009dc0 tx=0x7fe6fc02bde0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 -- 172.21.15.89:0/857924853 shutdown_connections 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 --2- 172.21.15.89:0/857924853 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe704144c40 0x7fe7040bcc70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 -- 172.21.15.89:0/857924853 >> 172.21.15.89:0/857924853 conn(0x7fe7040654f0 msgr2=0x7fe7040658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:38.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 -- 172.21.15.89:0/857924853 shutdown_connections 2023-08-25T09:42:38.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.512+0000 7fe70b457640 1 -- 172.21.15.89:0/857924853 wait complete. 2023-08-25T09:42:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 Processor -- start 2023-08-25T09:42:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 -- start start 2023-08-25T09:42:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7040b6ec0 0x7fe7040b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe704144c40 0x7fe7041461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 0x7fe704146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040b1e90 con 0x7fe70414ddb0 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704147430 con 0x7fe704144c40 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe70b457640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe704147710 con 0x7fe7040b6ec0 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe7099f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 0x7fe704146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe7099f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 0x7fe704146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55508/0 (socket says 172.21.15.89:55508) 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.513+0000 7fe7099f4640 1 -- 172.21.15.89:0/1366039453 learned_addr learned my addr 172.21.15.89:0/1366039453 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7089f2640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe704144c40 0x7fe7041461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7091f3640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7040b6ec0 0x7fe7040b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7099f4640 1 -- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7040b6ec0 msgr2=0x7fe7040b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7099f4640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7040b6ec0 0x7fe7040b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7099f4640 1 -- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe704144c40 msgr2=0x7fe7041461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.526 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7099f4640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe704144c40 0x7fe7041461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7099f4640 1 -- 172.21.15.89:0/1366039453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009a70 con 0x7fe70414ddb0 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe7099f4640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 0x7fe704146700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c390 tx=0x7fe70000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000052d0 con 0x7fe70414ddb0 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005430 con 0x7fe70414ddb0 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7041479f0 con 0x7fe70414ddb0 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700003810 con 0x7fe70414ddb0 2023-08-25T09:42:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.514+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe704147fb0 con 0x7fe70414ddb0 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.515+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe704073bf0 con 0x7fe70414ddb0 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.515+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe700003970 con 0x7fe70414ddb0 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.516+0000 7fe6f9ffb640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe6e806a050 0x7fe6e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.516+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe700087770 con 0x7fe70414ddb0 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.516+0000 7fe7091f3640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe6e806a050 0x7fe6e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.516+0000 7fe7091f3640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe6e806a050 0x7fe6e806c510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc036000 tx=0x7fe6fc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.520+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe7000531b0 con 0x7fe70414ddb0 2023-08-25T09:42:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.753+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe7040bc3d0 con 0x7fe70414ddb0 2023-08-25T09:42:38.758 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.757+0000 7fe6f9ffb640 1 -- 172.21.15.89:0/1366039453 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe7000567d0 con 0x7fe70414ddb0 2023-08-25T09:42:38.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.758+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe6e806a050 msgr2=0x7fe6e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.761 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.758+0000 7fe70b457640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe6e806a050 0x7fe6e806c510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc036000 tx=0x7fe6fc030000 comp rx=0 tx=0).stop 2023-08-25T09:42:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.758+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 msgr2=0x7fe704146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.758+0000 7fe70b457640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 0x7fe704146700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c390 tx=0x7fe70000c850 comp rx=0 tx=0).stop 2023-08-25T09:42:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 shutdown_connections 2023-08-25T09:42:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fe6e806a050 0x7fe6e806c510 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe70414ddb0 0x7fe704146700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.763 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe704144c40 0x7fe7041461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 --2- 172.21.15.89:0/1366039453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7040b6ec0 0x7fe7040b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 >> 172.21.15.89:0/1366039453 conn(0x7fe7040654f0 msgr2=0x7fe70414e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:38.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 shutdown_connections 2023-08-25T09:42:38.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.759+0000 7fe70b457640 1 -- 172.21.15.89:0/1366039453 wait complete. 2023-08-25T09:42:38.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-25T09:42:38.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.871+0000 7fc0abf24640 1 Processor -- start 2023-08-25T09:42:38.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.871+0000 7fc0abf24640 1 -- start start 2023-08-25T09:42:38.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0abf24640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc0a4144c40 0x7fc0a40bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0abf24640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a40b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0abf24640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4145020 con 0x7fc0a414ddb0 2023-08-25T09:42:38.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0abf24640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40b9330 con 0x7fc0a4144c40 2023-08-25T09:42:38.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0abf24640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40bd290 con 0x7fc0a40b6ec0 2023-08-25T09:42:38.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0a94bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a40b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0a9cc0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc0a4144c40 0x7fc0a40bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0a94bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a40b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:44164/0 (socket says 172.21.15.89:44164) 2023-08-25T09:42:38.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.872+0000 7fc0a94bf640 1 -- 172.21.15.89:0/494191115 learned_addr learned my addr 172.21.15.89:0/494191115 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:38.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a9cc0640 1 -- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 msgr2=0x7fc0a40b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a9cc0640 1 --2- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a40b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a9cc0640 1 -- 172.21.15.89:0/494191115 >> v1:172.21.15.121:6789/0 conn(0x7fc0a414ddb0 legacy=0x7fc0a40babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a9cc0640 1 -- 172.21.15.89:0/494191115 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40b8850 con 0x7fc0a4144c40 2023-08-25T09:42:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a94bf640 1 --2- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a40b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T09:42:38.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a9cc0640 1 --2- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a40bcc70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0940097a0 tx=0x7fc09402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b137fafadf9fc087 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a8cbe640 1 -- 172.21.15.89:0/494191115 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094031830 con 0x7fc0a4144c40 2023-08-25T09:42:38.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.873+0000 7fc0a8cbe640 1 -- 172.21.15.89:0/494191115 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094031990 con 0x7fc0a4144c40 2023-08-25T09:42:38.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0a8cbe640 1 -- 172.21.15.89:0/494191115 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094031d20 con 0x7fc0a4144c40 2023-08-25T09:42:38.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 -- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 msgr2=0x7fc0a40bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 --2- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a40bcc70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0940097a0 tx=0x7fc09402b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 -- 172.21.15.89:0/494191115 shutdown_connections 2023-08-25T09:42:38.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 --2- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a40b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 --2- 172.21.15.89:0/494191115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a40bcc70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 -- 172.21.15.89:0/494191115 >> 172.21.15.89:0/494191115 conn(0x7fc0a40654f0 msgr2=0x7fc0a40658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 -- 172.21.15.89:0/494191115 shutdown_connections 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.874+0000 7fc0abf24640 1 -- 172.21.15.89:0/494191115 wait complete. 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.875+0000 7fc0abf24640 1 Processor -- start 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.875+0000 7fc0abf24640 1 -- start start 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a41470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a41453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 0x7fc0a40b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41e0cd0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41dff10 con 0x7fc0a4144c40 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41e01f0 con 0x7fc0a40b6ec0 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 0x7fc0a40b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 0x7fc0a40b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55520/0 (socket says 172.21.15.89:55520) 2023-08-25T09:42:38.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 -- 172.21.15.89:0/1923256723 learned_addr learned my addr 172.21.15.89:0/1923256723 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0a9cc0640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a41470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0a94bf640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a41453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 -- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 msgr2=0x7fc0a41470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a41470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 -- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 msgr2=0x7fc0a41453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a41453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 -- 172.21.15.89:0/1923256723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00094d0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0aa4c1640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 0x7fc0a40b6360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00c6b0 tx=0x7fc09c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c003b70 con 0x7fc0a414ddb0 2023-08-25T09:42:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c003cf0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094009400 con 0x7fc0a414ddb0 2023-08-25T09:42:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c003ea0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.876+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a41e07b0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.877+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4073bf0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.878+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc09c005310 con 0x7fc0a414ddb0 2023-08-25T09:42:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.878+0000 7fc09a7fc640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc08806a050 0x7fc08806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.878+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc09c087ea0 con 0x7fc0a414ddb0 2023-08-25T09:42:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.878+0000 7fc0a9cc0640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc08806a050 0x7fc08806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.879+0000 7fc0a9cc0640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc08806a050 0x7fc08806c510 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc094036000 tx=0x7fc09403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:38.882+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc09c053990 con 0x7fc0a414ddb0 2023-08-25T09:42:39.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.116+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc0a40bc3d0 con 0x7fc0a414ddb0 2023-08-25T09:42:39.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.121+0000 7fc09a7fc640 1 -- 172.21.15.89:0/1923256723 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc09c056fb0 con 0x7fc0a414ddb0 2023-08-25T09:42:39.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc08806a050 msgr2=0x7fc08806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc08806a050 0x7fc08806c510 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc094036000 tx=0x7fc09403c040 comp rx=0 tx=0).stop 2023-08-25T09:42:39.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 msgr2=0x7fc0a40b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 0x7fc0a40b6360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00c6b0 tx=0x7fc09c00cb70 comp rx=0 tx=0).stop 2023-08-25T09:42:39.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 shutdown_connections 2023-08-25T09:42:39.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc08806a050 0x7fc08806c510 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a414ddb0 0x7fc0a40b6360 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a4144c40 0x7fc0a41453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 --2- 172.21.15.89:0/1923256723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0a40b6ec0 0x7fc0a41470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 >> 172.21.15.89:0/1923256723 conn(0x7fc0a40654f0 msgr2=0x7fc0a414e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:39.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 shutdown_connections 2023-08-25T09:42:39.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.123+0000 7fc0abf24640 1 -- 172.21.15.89:0/1923256723 wait complete. 2023-08-25T09:42:39.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-25T09:42:39.243 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.233+0000 7f4cf87a4640 1 Processor -- start 2023-08-25T09:42:39.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.233+0000 7f4cf87a4640 1 -- start start 2023-08-25T09:42:39.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf87a4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4cf014aa10 0x7f4cf01445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf87a4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4cf00b7130 0x7f4cf0144af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf87a4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf014af30 con 0x7f4cf00b8b90 2023-08-25T09:42:39.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf87a4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf014b8d0 con 0x7f4cf00b7130 2023-08-25T09:42:39.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf87a4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf014b210 con 0x7f4cf014aa10 2023-08-25T09:42:39.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4cf00b7130 0x7f4cf0144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4cf00b7130 0x7f4cf0144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55536/0 (socket says 172.21.15.89:55536) 2023-08-25T09:42:39.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 -- 172.21.15.89:0/911019711 learned_addr learned my addr 172.21.15.89:0/911019711 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:39.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf5d3f640 1 --2- 172.21.15.89:0/911019711 >> v2:172.21.15.121:3300/0 conn(0x7f4cf014aa10 0x7f4cf01445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 -- 172.21.15.89:0/911019711 >> v2:172.21.15.121:3300/0 conn(0x7f4cf014aa10 msgr2=0x7f4cf01445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:39.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 --2- 172.21.15.89:0/911019711 >> v2:172.21.15.121:3300/0 conn(0x7f4cf014aa10 0x7f4cf01445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 -- 172.21.15.89:0/911019711 >> v1:172.21.15.121:6789/0 conn(0x7f4cf00b8b90 legacy=0x7f4cf00b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:39.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.234+0000 7f4cf6d41640 1 -- 172.21.15.89:0/911019711 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf014b4f0 con 0x7f4cf00b7130 2023-08-25T09:42:39.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.235+0000 7f4cf6d41640 1 --2- 172.21.15.89:0/911019711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf00b7130 0x7f4cf0144af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4cf006ee10 tx=0x7f4ce802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00764872a97ec5e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.235+0000 7f4cf553e640 1 -- 172.21.15.89:0/911019711 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8031870 con 0x7f4cf00b7130 2023-08-25T09:42:39.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.235+0000 7f4cf553e640 1 -- 172.21.15.89:0/911019711 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce80319d0 con 0x7f4cf00b7130 2023-08-25T09:42:39.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.235+0000 7f4cf553e640 1 -- 172.21.15.89:0/911019711 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8031d60 con 0x7f4cf00b7130 2023-08-25T09:42:39.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 -- 172.21.15.89:0/911019711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf00b7130 msgr2=0x7f4cf0144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/911019711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf00b7130 0x7f4cf0144af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4cf006ee10 tx=0x7f4ce802b910 comp rx=0 tx=0).stop 2023-08-25T09:42:39.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 -- 172.21.15.89:0/911019711 shutdown_connections 2023-08-25T09:42:39.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/911019711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf00b7130 0x7f4cf0144af0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/911019711 >> v2:172.21.15.121:3300/0 conn(0x7f4cf014aa10 0x7f4cf01445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 -- 172.21.15.89:0/911019711 >> 172.21.15.89:0/911019711 conn(0x7f4cf0069a30 msgr2=0x7f4cf0069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:39.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 -- 172.21.15.89:0/911019711 shutdown_connections 2023-08-25T09:42:39.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.236+0000 7f4cf87a4640 1 -- 172.21.15.89:0/911019711 wait complete. 2023-08-25T09:42:39.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 Processor -- start 2023-08-25T09:42:39.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 -- start start 2023-08-25T09:42:39.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf00b7130 0x7f4cf013c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4cf00b8b90 0x7f4cf00b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 0x7f4cf01df6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf013cb20 con 0x7f4cf014aa10 2023-08-25T09:42:39.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00b3c00 con 0x7f4cf00b7130 2023-08-25T09:42:39.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf87a4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00b5d40 con 0x7f4cf00b8b90 2023-08-25T09:42:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf6d41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 0x7f4cf01df6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf6d41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 0x7f4cf01df6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55548/0 (socket says 172.21.15.89:55548) 2023-08-25T09:42:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.237+0000 7f4cf6d41640 1 -- 172.21.15.89:0/3650996738 learned_addr learned my addr 172.21.15.89:0/3650996738 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6d41640 1 -- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4cf00b8b90 msgr2=0x7f4cf00b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6540640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf00b7130 0x7f4cf013c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf5d3f640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4cf00b8b90 0x7f4cf00b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6d41640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4cf00b8b90 0x7f4cf00b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6d41640 1 -- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf00b7130 msgr2=0x7f4cf013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6d41640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf00b7130 0x7f4cf013c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6d41640 1 -- 172.21.15.89:0/3650996738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80094d0 con 0x7f4cf014aa10 2023-08-25T09:42:39.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf6d41640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 0x7f4cf01df6d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80090b0 tx=0x7f4ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce803ac60 con 0x7f4cf014aa10 2023-08-25T09:42:39.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce803adc0 con 0x7f4cf014aa10 2023-08-25T09:42:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf00b6000 con 0x7f4cf014aa10 2023-08-25T09:42:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8044630 con 0x7f4cf014aa10 2023-08-25T09:42:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.238+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf00b62e0 con 0x7f4cf014aa10 2023-08-25T09:42:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.239+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf00b3d90 con 0x7f4cf014aa10 2023-08-25T09:42:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.239+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ce804d450 con 0x7f4cf014aa10 2023-08-25T09:42:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.240+0000 7f4ce6ffd640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4cd406a050 0x7f4cd406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.240+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4ce802d040 con 0x7f4cf014aa10 2023-08-25T09:42:39.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.240+0000 7f4cf6540640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4cd406a050 0x7f4cd406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.240+0000 7f4cf6540640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4cd406a050 0x7f4cd406c510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cec007fd0 tx=0x7f4cec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.244+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ce80762b0 con 0x7f4cf014aa10 2023-08-25T09:42:39.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.473+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4cf0073bf0 con 0x7f4cf014aa10 2023-08-25T09:42:39.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.476+0000 7f4ce6ffd640 1 -- 172.21.15.89:0/3650996738 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ce80798d0 con 0x7f4cf014aa10 2023-08-25T09:42:39.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4cd406a050 msgr2=0x7f4cd406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4cd406a050 0x7f4cd406c510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cec007fd0 tx=0x7f4cec009040 comp rx=0 tx=0).stop 2023-08-25T09:42:39.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 msgr2=0x7f4cf01df6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 0x7f4cf01df6d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80090b0 tx=0x7f4ce80046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 shutdown_connections 2023-08-25T09:42:39.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f4cd406a050 0x7f4cd406c510 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cf014aa10 0x7f4cf01df6d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4cf00b8b90 0x7f4cf00b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 --2- 172.21.15.89:0/3650996738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf00b7130 0x7f4cf013c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 >> 172.21.15.89:0/3650996738 conn(0x7f4cf0069a30 msgr2=0x7f4cf0143ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:39.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.478+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 shutdown_connections 2023-08-25T09:42:39.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.479+0000 7f4cf87a4640 1 -- 172.21.15.89:0/3650996738 wait complete. 2023-08-25T09:42:39.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.594+0000 7f58d49b1640 1 Processor -- start 2023-08-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.594+0000 7f58d49b1640 1 -- start start 2023-08-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58d49b1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58d0144c00 0x7f58d00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58d49b1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f58d014a740 0x7f58d00654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58d49b1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d006aa70 con 0x7f58d006efc0 2023-08-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58d49b1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00b6770 con 0x7f58d0144c00 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58d49b1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00b6a50 con 0x7f58d014a740 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58d0144c00 0x7f58d00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58d0144c00 0x7f58d00700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55554/0 (socket says 172.21.15.89:55554) 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 -- 172.21.15.89:0/17471863 learned_addr learned my addr 172.21.15.89:0/17471863 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58c7fff640 1 --2- 172.21.15.89:0/17471863 >> v2:172.21.15.121:3300/0 conn(0x7f58d014a740 0x7f58d00654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 -- 172.21.15.89:0/17471863 >> v2:172.21.15.121:3300/0 conn(0x7f58d014a740 msgr2=0x7f58d00654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:39.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 --2- 172.21.15.89:0/17471863 >> v2:172.21.15.121:3300/0 conn(0x7f58d014a740 0x7f58d00654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 -- 172.21.15.89:0/17471863 >> v1:172.21.15.121:6789/0 conn(0x7f58d006efc0 legacy=0x7f58d00b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:39.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.595+0000 7f58ce59c640 1 -- 172.21.15.89:0/17471863 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d006fba0 con 0x7f58d0144c00 2023-08-25T09:42:39.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58ce59c640 1 --2- 172.21.15.89:0/17471863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d00700c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58d014b850 tx=0x7f58c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907a98a87f92c73 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58cdd9b640 1 -- 172.21.15.89:0/17471863 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0031870 con 0x7f58d0144c00 2023-08-25T09:42:39.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58cdd9b640 1 -- 172.21.15.89:0/17471863 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00319d0 con 0x7f58d0144c00 2023-08-25T09:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58cdd9b640 1 -- 172.21.15.89:0/17471863 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0031d60 con 0x7f58d0144c00 2023-08-25T09:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 -- 172.21.15.89:0/17471863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 msgr2=0x7f58d00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 --2- 172.21.15.89:0/17471863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d00700c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58d014b850 tx=0x7f58c002b910 comp rx=0 tx=0).stop 2023-08-25T09:42:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 -- 172.21.15.89:0/17471863 shutdown_connections 2023-08-25T09:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 --2- 172.21.15.89:0/17471863 >> v2:172.21.15.121:3300/0 conn(0x7f58d014a740 0x7f58d00654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 --2- 172.21.15.89:0/17471863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d00700c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 -- 172.21.15.89:0/17471863 >> 172.21.15.89:0/17471863 conn(0x7f58d0069850 msgr2=0x7f58d0069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 -- 172.21.15.89:0/17471863 shutdown_connections 2023-08-25T09:42:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.596+0000 7f58d49b1640 1 -- 172.21.15.89:0/17471863 wait complete. 2023-08-25T09:42:39.605 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.597+0000 7f58d49b1640 1 Processor -- start 2023-08-25T09:42:39.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 -- start start 2023-08-25T09:42:39.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58d006efc0 0x7f58d01d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d01d3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58d01d3bb0 0x7f58d01d1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01d3220 con 0x7f58d0144c00 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01d1100 con 0x7f58d006efc0 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58d49b1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01d4040 con 0x7f58d01d3bb0 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d01d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d01d3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55562/0 (socket says 172.21.15.89:55562) 2023-08-25T09:42:39.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 -- 172.21.15.89:0/1918638921 learned_addr learned my addr 172.21.15.89:0/1918638921 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:39.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58ced9d640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58d01d3bb0 0x7f58d01d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58ce59c640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58d006efc0 0x7f58d01d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 -- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58d01d3bb0 msgr2=0x7f58d01d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58d01d3bb0 0x7f58d01d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 -- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58d006efc0 msgr2=0x7f58d01d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58d006efc0 0x7f58d01d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.598+0000 7f58c7fff640 1 -- 172.21.15.89:0/1918638921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c00094d0 con 0x7f58d0144c00 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.599+0000 7f58c7fff640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d01d3670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f58b800d650 tx=0x7f58b800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.599+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800b6c0 con 0x7f58d0144c00 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.599+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b800b820 con 0x7f58d0144c00 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.599+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d01d2f40 con 0x7f58d0144c00 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.599+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800bbd0 con 0x7f58d0144c00 2023-08-25T09:42:39.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.599+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d01d2b20 con 0x7f58d0144c00 2023-08-25T09:42:39.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.600+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d01d2da0 con 0x7f58d0144c00 2023-08-25T09:42:39.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.600+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58b800bd30 con 0x7f58d0144c00 2023-08-25T09:42:39.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.601+0000 7f58c6ffd640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b006a080 0x7f58b006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.601+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f58b8088600 con 0x7f58d0144c00 2023-08-25T09:42:39.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.601+0000 7f58ce59c640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b006a080 0x7f58b006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.601+0000 7f58ce59c640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b006a080 0x7f58b006c540 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f58c0036000 tx=0x7f58c003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.605+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f58d01d2da0 con 0x7f58d0144c00 2023-08-25T09:42:39.834 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.833+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f58d01d2da0 con 0x7f58d0144c00 2023-08-25T09:42:39.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.836+0000 7f58c6ffd640 1 -- 172.21.15.89:0/1918638921 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f58d01d2da0 con 0x7f58d0144c00 2023-08-25T09:42:39.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b006a080 msgr2=0x7f58b006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b006a080 0x7f58b006c540 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f58c0036000 tx=0x7f58c003c040 comp rx=0 tx=0).stop 2023-08-25T09:42:39.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 msgr2=0x7f58d01d3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d01d3670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f58b800d650 tx=0x7f58b800db10 comp rx=0 tx=0).stop 2023-08-25T09:42:39.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 shutdown_connections 2023-08-25T09:42:39.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f58b006a080 0x7f58b006c540 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58d0144c00 0x7f58d01d3670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58d01d3bb0 0x7f58d01d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 --2- 172.21.15.89:0/1918638921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58d006efc0 0x7f58d01d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 >> 172.21.15.89:0/1918638921 conn(0x7f58d0069850 msgr2=0x7f58d00654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:39.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 shutdown_connections 2023-08-25T09:42:39.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.838+0000 7f58d49b1640 1 -- 172.21.15.89:0/1918638921 wait complete. 2023-08-25T09:42:39.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:39.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.949+0000 7fd1fdd12640 1 Processor -- start 2023-08-25T09:42:39.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.949+0000 7fd1fdd12640 1 -- start start 2023-08-25T09:42:39.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1fdd12640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1f80b6ec0 0x7fd1f80bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1fdd12640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ddb0 0x7fd1f814e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1fdd12640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f8145020 con 0x7fd1f8144c40 2023-08-25T09:42:39.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1fdd12640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80b9330 con 0x7fd1f80b6ec0 2023-08-25T09:42:39.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1fdd12640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80b7d70 con 0x7fd1f814ddb0 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1f80b6ec0 0x7fd1f80bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1f80b6ec0 0x7fd1f80bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55576/0 (socket says 172.21.15.89:55576) 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 -- 172.21.15.89:0/1110370386 learned_addr learned my addr 172.21.15.89:0/1110370386 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1f7fff640 1 --2- 172.21.15.89:0/1110370386 >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ddb0 0x7fd1f814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 -- 172.21.15.89:0/1110370386 >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ddb0 msgr2=0x7fd1f814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 --2- 172.21.15.89:0/1110370386 >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ddb0 0x7fd1f814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 -- 172.21.15.89:0/1110370386 >> v1:172.21.15.121:6789/0 conn(0x7fd1f8144c40 legacy=0x7fd1f80b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1eeffd640 1 -- 172.21.15.89:0/1110370386 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80bd290 con 0x7fd1f80b6ec0 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.950+0000 7fd1f7fff640 1 --2- 172.21.15.89:0/1110370386 >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ddb0 0x7fd1f814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.951+0000 7fd1eeffd640 1 --2- 172.21.15.89:0/1110370386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80bcc70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80bd730 tx=0x7fd1e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a60394f5d30266 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.951+0000 7fd1f6ffd640 1 -- 172.21.15.89:0/1110370386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0031870 con 0x7fd1f80b6ec0 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.951+0000 7fd1f6ffd640 1 -- 172.21.15.89:0/1110370386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e00319d0 con 0x7fd1f80b6ec0 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.951+0000 7fd1f6ffd640 1 -- 172.21.15.89:0/1110370386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0031d60 con 0x7fd1f80b6ec0 2023-08-25T09:42:39.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 -- 172.21.15.89:0/1110370386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f80b6ec0 msgr2=0x7fd1f80bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/1110370386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80bcc70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80bd730 tx=0x7fd1e002b910 comp rx=0 tx=0).stop 2023-08-25T09:42:39.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 -- 172.21.15.89:0/1110370386 shutdown_connections 2023-08-25T09:42:39.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/1110370386 >> v2:172.21.15.121:3300/0 conn(0x7fd1f814ddb0 0x7fd1f814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/1110370386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80bcc70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 -- 172.21.15.89:0/1110370386 >> 172.21.15.89:0/1110370386 conn(0x7fd1f80654f0 msgr2=0x7fd1f80658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:39.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 -- 172.21.15.89:0/1110370386 shutdown_connections 2023-08-25T09:42:39.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.952+0000 7fd1fdd12640 1 -- 172.21.15.89:0/1110370386 wait complete. 2023-08-25T09:42:39.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.953+0000 7fd1fdd12640 1 Processor -- start 2023-08-25T09:42:39.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.953+0000 7fd1fdd12640 1 -- start start 2023-08-25T09:42:39.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80be690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1f8144c40 0x7fd1f80b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 0x7fd1f80a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80a5a90 con 0x7fd1f814ddb0 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80bebd0 con 0x7fd1f80b6ec0 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80c0790 con 0x7fd1f8144c40 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 0x7fd1f80a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 0x7fd1f80a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55580/0 (socket says 172.21.15.89:55580) 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 -- 172.21.15.89:0/4252267069 learned_addr learned my addr 172.21.15.89:0/4252267069 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f77fe640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1eeffd640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1f8144c40 0x7fd1f80b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 -- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1f8144c40 msgr2=0x7fd1f80b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1f8144c40 0x7fd1f80b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 -- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f80b6ec0 msgr2=0x7fd1f80be690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:39.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80be690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:39.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 -- 172.21.15.89:0/4252267069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00094d0 con 0x7fd1f814ddb0 2023-08-25T09:42:39.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f7fff640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 0x7fd1f80a4d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000cd50 tx=0x7fd1f000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000f680 con 0x7fd1f814ddb0 2023-08-25T09:42:39.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000f800 con 0x7fd1f814ddb0 2023-08-25T09:42:39.970 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f80c01a0 con 0x7fd1f814ddb0 2023-08-25T09:42:39.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000fbb0 con 0x7fd1f814ddb0 2023-08-25T09:42:39.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.954+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f80c0c20 con 0x7fd1f814ddb0 2023-08-25T09:42:39.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.955+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f80b8830 con 0x7fd1f814ddb0 2023-08-25T09:42:39.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.956+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd1f000b040 con 0x7fd1f814ddb0 2023-08-25T09:42:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.956+0000 7fd1f4ff9640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd1d806a050 0x7fd1d806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.956+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd1f0088a50 con 0x7fd1f814ddb0 2023-08-25T09:42:39.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.956+0000 7fd1f77fe640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd1d806a050 0x7fd1d806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:39.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.957+0000 7fd1f77fe640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd1d806a050 0x7fd1d806c510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8004f60 tx=0x7fd1e8007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:39.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:39.961+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd1f80b8830 con 0x7fd1f814ddb0 2023-08-25T09:42:40.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.131+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f80b3800 con 0x7fd1f814ddb0 2023-08-25T09:42:40.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.131+0000 7fd1f4ff9640 1 -- 172.21.15.89:0/4252267069 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14639 (secure 0 0 0) 0x7fd1f80b3800 con 0x7fd1f814ddb0 2023-08-25T09:42:40.136 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:40.136 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":30,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:37.261973+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:40.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd1d806a050 msgr2=0x7fd1d806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.137 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd1d806a050 0x7fd1d806c510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8004f60 tx=0x7fd1e8007e30 comp rx=0 tx=0).stop 2023-08-25T09:42:40.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 msgr2=0x7fd1f80a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 0x7fd1f80a4d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000cd50 tx=0x7fd1f000a650 comp rx=0 tx=0).stop 2023-08-25T09:42:40.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 shutdown_connections 2023-08-25T09:42:40.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fd1d806a050 0x7fd1d806c510 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.139 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f814ddb0 0x7fd1f80a4d00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1f8144c40 0x7fd1f80b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 --2- 172.21.15.89:0/4252267069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1f80b6ec0 0x7fd1f80be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 >> 172.21.15.89:0/4252267069 conn(0x7fd1f80654f0 msgr2=0x7fd1f814e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:40.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 shutdown_connections 2023-08-25T09:42:40.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.133+0000 7fd1fdd12640 1 -- 172.21.15.89:0/4252267069 wait complete. 2023-08-25T09:42:40.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T09:42:40.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T09:42:40.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.251+0000 7f96bc8b8640 1 Processor -- start 2023-08-25T09:42:40.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.251+0000 7f96bc8b8640 1 -- start start 2023-08-25T09:42:40.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96bc8b8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b8144560 0x7f96b8144980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96bc8b8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96b814a9a0 0x7f96b814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96bc8b8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80ba300 con 0x7f96b80bcf70 2023-08-25T09:42:40.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96bc8b8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b80b9640 con 0x7f96b814a9a0 2023-08-25T09:42:40.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96bc8b8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80bcb40 con 0x7f96b8144560 2023-08-25T09:42:40.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96b6d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96b814a9a0 0x7f96b814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96b6d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96b814a9a0 0x7f96b814adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55586/0 (socket says 172.21.15.89:55586) 2023-08-25T09:42:40.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96b6d9d640 1 -- 172.21.15.89:0/2092210859 learned_addr learned my addr 172.21.15.89:0/2092210859 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:40.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.252+0000 7f96affff640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b8144560 0x7f96b8144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b6d9d640 1 -- 172.21.15.89:0/2092210859 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b8144560 msgr2=0x7f96b8144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b6d9d640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b8144560 0x7f96b8144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b6d9d640 1 -- 172.21.15.89:0/2092210859 >> v1:172.21.15.121:6789/0 conn(0x7f96b80bcf70 legacy=0x7f96b80bc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b6d9d640 1 -- 172.21.15.89:0/2092210859 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b814b330 con 0x7f96b814a9a0 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96affff640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b8144560 0x7f96b8144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b6d9d640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b814a9a0 0x7f96b814adf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009e50 tx=0x7f96b002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae6f0cbf3fc6967 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b5d9b640 1 -- 172.21.15.89:0/2092210859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b002cb00 con 0x7f96b814a9a0 2023-08-25T09:42:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b5d9b640 1 -- 172.21.15.89:0/2092210859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b002cc60 con 0x7f96b814a9a0 2023-08-25T09:42:40.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.253+0000 7f96b5d9b640 1 -- 172.21.15.89:0/2092210859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00343f0 con 0x7f96b814a9a0 2023-08-25T09:42:40.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 -- 172.21.15.89:0/2092210859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b814a9a0 msgr2=0x7f96b814adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b814a9a0 0x7f96b814adf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009e50 tx=0x7f96b002bf60 comp rx=0 tx=0).stop 2023-08-25T09:42:40.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 -- 172.21.15.89:0/2092210859 shutdown_connections 2023-08-25T09:42:40.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b814a9a0 0x7f96b814adf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/2092210859 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b8144560 0x7f96b8144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 -- 172.21.15.89:0/2092210859 >> 172.21.15.89:0/2092210859 conn(0x7f96b80654f0 msgr2=0x7f96b80658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:40.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 -- 172.21.15.89:0/2092210859 shutdown_connections 2023-08-25T09:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.254+0000 7f96bc8b8640 1 -- 172.21.15.89:0/2092210859 wait complete. 2023-08-25T09:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.255+0000 7f96bc8b8640 1 Processor -- start 2023-08-25T09:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.255+0000 7f96bc8b8640 1 -- start start 2023-08-25T09:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96bc8b8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96b80bcf70 0x7f96b8145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96bc8b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 0x7f96b81dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96bc8b8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b814a9a0 0x7f96b80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96bc8b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8149030 con 0x7f96b8144560 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96bc8b8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b81458a0 con 0x7f96b80bcf70 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96bc8b8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8145b70 con 0x7f96b814a9a0 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 0x7f96b81dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 0x7f96b81dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55602/0 (socket says 172.21.15.89:55602) 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 -- 172.21.15.89:0/3561792784 learned_addr learned my addr 172.21.15.89:0/3561792784 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96b6d9d640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b814a9a0 0x7f96b80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96b659c640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96b80bcf70 0x7f96b8145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 -- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b814a9a0 msgr2=0x7f96b80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b814a9a0 0x7f96b80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 -- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96b80bcf70 msgr2=0x7f96b8145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96b80bcf70 0x7f96b8145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 -- 172.21.15.89:0/3561792784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0009b30 con 0x7f96b8144560 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96b659c640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96b80bcf70 0x7f96b8145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96affff640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 0x7f96b81dff30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f96a000e7e0 tx=0x7f96a000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0004030 con 0x7f96b8144560 2023-08-25T09:42:40.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.256+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0004190 con 0x7f96b8144560 2023-08-25T09:42:40.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.257+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b8148a70 con 0x7f96b8144560 2023-08-25T09:42:40.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.257+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0004520 con 0x7f96b8144560 2023-08-25T09:42:40.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.257+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b81dfa10 con 0x7f96b8144560 2023-08-25T09:42:40.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.257+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b81df840 con 0x7f96b8144560 2023-08-25T09:42:40.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.258+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96a000c6d0 con 0x7f96b8144560 2023-08-25T09:42:40.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.258+0000 7f96aeffd640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f969806a050 0x7f969806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.258+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f96a0087e00 con 0x7f96b8144560 2023-08-25T09:42:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.258+0000 7f96b659c640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f969806a050 0x7f969806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.259+0000 7f96b659c640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f969806a050 0x7f969806c510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f96a8001660 tx=0x7f96a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.262+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96a0053980 con 0x7f96b8144560 2023-08-25T09:42:40.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.427+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96b80c1070 con 0x7f96b8144560 2023-08-25T09:42:40.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.428+0000 7f96aeffd640 1 -- 172.21.15.89:0/3561792784 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96a0056fa0 con 0x7f96b8144560 2023-08-25T09:42:40.431 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T09:42:40.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f969806a050 msgr2=0x7f969806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f969806a050 0x7f969806c510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f96a8001660 tx=0x7f96a8009040 comp rx=0 tx=0).stop 2023-08-25T09:42:40.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 msgr2=0x7f96b81dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 0x7f96b81dff30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f96a000e7e0 tx=0x7f96a000eca0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 shutdown_connections 2023-08-25T09:42:40.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f969806a050 0x7f969806c510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144560 0x7f96b81dff30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96b814a9a0 0x7f96b80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 --2- 172.21.15.89:0/3561792784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96b80bcf70 0x7f96b8145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 >> 172.21.15.89:0/3561792784 conn(0x7f96b80654f0 msgr2=0x7f96b80c0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:40.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 shutdown_connections 2023-08-25T09:42:40.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.429+0000 7f96bc8b8640 1 -- 172.21.15.89:0/3561792784 wait complete. 2023-08-25T09:42:40.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T09:42:40.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.543+0000 7f3fcb7c2640 1 Processor -- start 2023-08-25T09:42:40.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.543+0000 7f3fcb7c2640 1 -- start start 2023-08-25T09:42:40.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fcb7c2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc406aad0 0x7f3fc40b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fcb7c2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fc4071bd0 0x7f3fc406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fcb7c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3fc4144580 0x7f3fc4144a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fcb7c2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc4070e40 con 0x7f3fc4071bd0 2023-08-25T09:42:40.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fcb7c2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc406fd50 con 0x7f3fc4144580 2023-08-25T09:42:40.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fcb7c2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4144f50 con 0x7f3fc406aad0 2023-08-25T09:42:40.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fc4071bd0 0x7f3fc406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fc4071bd0 0x7f3fc406ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55616/0 (socket says 172.21.15.89:55616) 2023-08-25T09:42:40.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/532695257 learned_addr learned my addr 172.21.15.89:0/532695257 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:40.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc955e640 1 --2- 172.21.15.89:0/532695257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc406aad0 0x7f3fc40b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc9d5f640 1 --2- 172.21.15.89:0/532695257 >> v2:172.21.15.121:3300/0 conn(0x7f3fc4144580 0x7f3fc4144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/532695257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc406aad0 msgr2=0x7f3fc40b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 --2- 172.21.15.89:0/532695257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc406aad0 0x7f3fc40b88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/532695257 >> v2:172.21.15.121:3300/0 conn(0x7f3fc4144580 msgr2=0x7f3fc4144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 --2- 172.21.15.89:0/532695257 >> v2:172.21.15.121:3300/0 conn(0x7f3fc4144580 0x7f3fc4144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.544+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/532695257 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40b8460 con 0x7f3fc4071bd0 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.545+0000 7f3fc8d5d640 1 --2- 172.21.15.89:0/532695257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc406ef80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009870 tx=0x7f3fc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b545923bfff3c079 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.545+0000 7f3fbbfff640 1 -- 172.21.15.89:0/532695257 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0031640 con 0x7f3fc4071bd0 2023-08-25T09:42:40.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.545+0000 7f3fbbfff640 1 -- 172.21.15.89:0/532695257 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc00317a0 con 0x7f3fc4071bd0 2023-08-25T09:42:40.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.545+0000 7f3fbbfff640 1 -- 172.21.15.89:0/532695257 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0031b30 con 0x7f3fc4071bd0 2023-08-25T09:42:40.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/532695257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 msgr2=0x7f3fc406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/532695257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc406ef80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009870 tx=0x7f3fc002b8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/532695257 shutdown_connections 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/532695257 >> v2:172.21.15.121:3300/0 conn(0x7f3fc4144580 0x7f3fc4144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/532695257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc406ef80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/532695257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc406aad0 0x7f3fc40b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/532695257 >> 172.21.15.89:0/532695257 conn(0x7f3fc40b91c0 msgr2=0x7f3fc40b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/532695257 shutdown_connections 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.546+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/532695257 wait complete. 2023-08-25T09:42:40.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 Processor -- start 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 -- start start 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc406aad0 0x7f3fc413a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc4144580 0x7f3fc413e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc41398b0 con 0x7f3fc4071bd0 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4139ab0 con 0x7f3fc406aad0 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.547+0000 7f3fcb7c2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc41e0210 con 0x7f3fc4144580 2023-08-25T09:42:40.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc414d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55632/0 (socket says 172.21.15.89:55632) 2023-08-25T09:42:40.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/3835492523 learned_addr learned my addr 172.21.15.89:0/3835492523 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:40.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc9d5f640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc4144580 0x7f3fc413e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc955e640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc406aad0 0x7f3fc413a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc4144580 msgr2=0x7f3fc413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc4144580 0x7f3fc413e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc406aad0 msgr2=0x7f3fc413a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc406aad0 0x7f3fc413a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 -- 172.21.15.89:0/3835492523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00094d0 con 0x7f3fc4071bd0 2023-08-25T09:42:40.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc955e640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc406aad0 0x7f3fc413a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:40.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fc8d5d640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc414d930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009870 tx=0x7f3fc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc003a8b0 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc003aa10 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc003adc0 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc41df910 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.548+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc413aa60 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.549+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc41dfd00 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.550+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3fc002f050 con 0x7f3fc4071bd0 2023-08-25T09:42:40.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.550+0000 7f3fb9ffb640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3fa806a050 0x7f3fa806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.550+0000 7f3fc955e640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3fa806a050 0x7f3fa806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.550+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3fc00aa030 con 0x7f3fc4071bd0 2023-08-25T09:42:40.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.551+0000 7f3fc955e640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3fa806a050 0x7f3fa806c510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009a40 tx=0x7f3fb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.554+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3fc41dfd00 con 0x7f3fc4071bd0 2023-08-25T09:42:40.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.722+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fc413f370 con 0x7f3fc4071bd0 2023-08-25T09:42:40.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.722+0000 7f3fb9ffb640 1 -- 172.21.15.89:0/3835492523 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fc413f370 con 0x7f3fc4071bd0 2023-08-25T09:42:40.726 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T09:42:40.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3fa806a050 msgr2=0x7f3fa806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3fa806a050 0x7f3fa806c510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009a40 tx=0x7f3fb4008040 comp rx=0 tx=0).stop 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 msgr2=0x7f3fc414d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc414d930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009870 tx=0x7f3fc00046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 shutdown_connections 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3fa806a050 0x7f3fa806c510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4071bd0 0x7f3fc414d930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fc4144580 0x7f3fc413e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 --2- 172.21.15.89:0/3835492523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc406aad0 0x7f3fc413a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 >> 172.21.15.89:0/3835492523 conn(0x7f3fc40b91c0 msgr2=0x7f3fc4143bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:40.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 shutdown_connections 2023-08-25T09:42:40.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.724+0000 7f3fcb7c2640 1 -- 172.21.15.89:0/3835492523 wait complete. 2023-08-25T09:42:40.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T09:42:40.838 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.837+0000 7f93dfb22640 1 Processor -- start 2023-08-25T09:42:40.839 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.837+0000 7f93dfb22640 1 -- start start 2023-08-25T09:42:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.837+0000 7f93dfb22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93d8070120 0x7f93d8070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.837+0000 7f93dfb22640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f93d80b2e20 0x7f93d806f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dfb22640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d8070a40 con 0x7f93d8146f60 2023-08-25T09:42:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dfb22640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d806ec00 con 0x7f93d8070120 2023-08-25T09:42:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dfb22640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d806f560 con 0x7f93d80b2e20 2023-08-25T09:42:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd8be640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93d8070120 0x7f93d8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd0bd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f93d8146f60 0x7f93d81441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57670/0 (socket says 172.21.15.89:57670) 2023-08-25T09:42:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd0bd640 1 -- 172.21.15.89:0/1196599898 learned_addr learned my addr 172.21.15.89:0/1196599898 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd8be640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93d8070120 0x7f93d8070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55638/0 (socket says 172.21.15.89:55638) 2023-08-25T09:42:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93de0bf640 1 --2- 172.21.15.89:0/1196599898 >> v2:172.21.15.121:3300/0 conn(0x7f93d80b2e20 0x7f93d806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd8be640 1 -- 172.21.15.89:0/1196599898 >> v2:172.21.15.121:3300/0 conn(0x7f93d80b2e20 msgr2=0x7f93d806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd8be640 1 --2- 172.21.15.89:0/1196599898 >> v2:172.21.15.121:3300/0 conn(0x7f93d80b2e20 0x7f93d806f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd8be640 1 -- 172.21.15.89:0/1196599898 >> v1:172.21.15.89:6789/0 conn(0x7f93d8146f60 legacy=0x7f93d81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dd8be640 1 -- 172.21.15.89:0/1196599898 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80b3530 con 0x7f93d8070120 2023-08-25T09:42:40.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.838+0000 7f93dc8bc640 1 -- 172.21.15.89:0/1196599898 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616555562 0 0) 0x7f93c8001110 con 0x7f93d8146f60 2023-08-25T09:42:40.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dd8be640 1 --2- 172.21.15.89:0/1196599898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8070120 0x7f93d8070500 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f93d80b5da0 tx=0x7f93d402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34e5e23ced71c0e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dc8bc640 1 -- 172.21.15.89:0/1196599898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d402edc0 con 0x7f93d8070120 2023-08-25T09:42:40.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dc8bc640 1 -- 172.21.15.89:0/1196599898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4036440 con 0x7f93d8070120 2023-08-25T09:42:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dc8bc640 1 -- 172.21.15.89:0/1196599898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40367d0 con 0x7f93d8070120 2023-08-25T09:42:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 -- 172.21.15.89:0/1196599898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8070120 msgr2=0x7f93d8070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 --2- 172.21.15.89:0/1196599898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8070120 0x7f93d8070500 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f93d80b5da0 tx=0x7f93d402e010 comp rx=0 tx=0).stop 2023-08-25T09:42:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 -- 172.21.15.89:0/1196599898 shutdown_connections 2023-08-25T09:42:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 --2- 172.21.15.89:0/1196599898 >> v2:172.21.15.121:3300/0 conn(0x7f93d80b2e20 0x7f93d806f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 --2- 172.21.15.89:0/1196599898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8070120 0x7f93d8070500 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 -- 172.21.15.89:0/1196599898 >> 172.21.15.89:0/1196599898 conn(0x7f93d8069a30 msgr2=0x7f93d8069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 -- 172.21.15.89:0/1196599898 shutdown_connections 2023-08-25T09:42:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.839+0000 7f93dfb22640 1 -- 172.21.15.89:0/1196599898 wait complete. 2023-08-25T09:42:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.840+0000 7f93dfb22640 1 Processor -- start 2023-08-25T09:42:40.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.840+0000 7f93dfb22640 1 -- start start 2023-08-25T09:42:40.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dfb22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93d8070120 0x7f93d81dc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dfb22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d80b2e20 0x7f93d8141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dfb22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 0x7f93d81df410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dfb22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d814b1c0 con 0x7f93d8146f60 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dfb22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81db850 con 0x7f93d80b2e20 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dfb22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80ba330 con 0x7f93d8070120 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 0x7f93d81df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 0x7f93d81df410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55648/0 (socket says 172.21.15.89:55648) 2023-08-25T09:42:40.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 -- 172.21.15.89:0/2004035968 learned_addr learned my addr 172.21.15.89:0/2004035968 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:40.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dd8be640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93d8070120 0x7f93d81dc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dd0bd640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d80b2e20 0x7f93d8141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 -- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93d8070120 msgr2=0x7f93d81dc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93d8070120 0x7f93d81dc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 -- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d80b2e20 msgr2=0x7f93d8141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:40.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d80b2e20 0x7f93d8141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93de0bf640 1 -- 172.21.15.89:0/2004035968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d400b6a0 con 0x7f93d8146f60 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dd8be640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93d8070120 0x7f93d81dc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.841+0000 7f93dd0bd640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d80b2e20 0x7f93d8141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.842+0000 7f93de0bf640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 0x7f93d81df410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007e10 tx=0x7f93d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.842+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0014620 con 0x7f93d8146f60 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.842+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00147a0 con 0x7f93d8146f60 2023-08-25T09:42:40.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.842+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0014b50 con 0x7f93d8146f60 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.842+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d814ac00 con 0x7f93d8146f60 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.842+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81deef0 con 0x7f93d8146f60 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.843+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d81ded50 con 0x7f93d8146f60 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.843+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93d0014cb0 con 0x7f93d8146f60 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.843+0000 7f93ce7fc640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f93bc06a050 0x7f93bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.844+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f93d0088af0 con 0x7f93d8146f60 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.844+0000 7f93dd8be640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f93bc06a050 0x7f93bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:40.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.844+0000 7f93dd8be640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f93bc06a050 0x7f93bc06c510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f93d4038000 tx=0x7f93d4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:40.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:40.848+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93d81ded50 con 0x7f93d8146f60 2023-08-25T09:42:41.017 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.016+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f93d81ded50 con 0x7f93d8146f60 2023-08-25T09:42:41.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.016+0000 7f93ce7fc640 1 -- 172.21.15.89:0/2004035968 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7f93d81ded50 con 0x7f93d8146f60 2023-08-25T09:42:41.018 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:41.018 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2023-08-25T09:42:41.018 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:41.018 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 2, 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "rbd" 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-08-25T09:42:41.019 INFO:teuthology.orchestra.run.smithi089.stdout:] 2023-08-25T09:42:41.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f93bc06a050 msgr2=0x7f93bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f93bc06a050 0x7f93bc06c510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f93d4038000 tx=0x7f93d4032000 comp rx=0 tx=0).stop 2023-08-25T09:42:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 msgr2=0x7f93d81df410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 0x7f93d81df410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007e10 tx=0x7f93d000e4b0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 shutdown_connections 2023-08-25T09:42:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f93bc06a050 0x7f93bc06c510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93d8146f60 0x7f93d81df410 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d80b2e20 0x7f93d8141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 --2- 172.21.15.89:0/2004035968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93d8070120 0x7f93d81dc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 >> 172.21.15.89:0/2004035968 conn(0x7f93d8069a30 msgr2=0x7f93d80b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 shutdown_connections 2023-08-25T09:42:41.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.018+0000 7f93dfb22640 1 -- 172.21.15.89:0/2004035968 wait complete. 2023-08-25T09:42:41.030 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T09:42:41.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T09:42:41.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.134+0000 7fa891271640 1 Processor -- start 2023-08-25T09:42:41.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.134+0000 7fa891271640 1 -- start start 2023-08-25T09:42:41.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa891271640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa88c14ae30 0x7fa88c14b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:41.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa891271640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:41.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa891271640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c148ac0 con 0x7fa88c0b2d00 2023-08-25T09:42:41.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa891271640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c1490f0 con 0x7fa88c14ae30 2023-08-25T09:42:41.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa891271640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c149f00 con 0x7fa88c149510 2023-08-25T09:42:41.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa88c14ae30 0x7fa88c14b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:41.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa88c14ae30 0x7fa88c14b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55650/0 (socket says 172.21.15.89:55650) 2023-08-25T09:42:41.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 -- 172.21.15.89:0/1850298211 learned_addr learned my addr 172.21.15.89:0/1850298211 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:41.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88a7fc640 1 --1- 172.21.15.89:0/1850298211 >> v1:172.21.15.89:6789/0 conn(0x7fa88c0b2d00 0x7fa88c0709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57680/0 (socket says 172.21.15.89:57680) 2023-08-25T09:42:41.143 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88b7fe640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:41.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 -- 172.21.15.89:0/1850298211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 msgr2=0x7fa88c1499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:41.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c1499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 -- 172.21.15.89:0/1850298211 >> v1:172.21.15.89:6789/0 conn(0x7fa88c0b2d00 legacy=0x7fa88c0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:41.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa889ffb640 1 -- 172.21.15.89:0/1850298211 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107051704 0 0) 0x7fa88c148ac0 con 0x7fa88c0b2d00 2023-08-25T09:42:41.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88affd640 1 -- 172.21.15.89:0/1850298211 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0710e0 con 0x7fa88c14ae30 2023-08-25T09:42:41.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.135+0000 7fa88b7fe640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:41.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.136+0000 7fa88affd640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c14b210 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009e50 tx=0x7fa87c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f903adacdcf38c92 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:41.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.136+0000 7fa889ffb640 1 -- 172.21.15.89:0/1850298211 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c02ca70 con 0x7fa88c14ae30 2023-08-25T09:42:41.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.136+0000 7fa889ffb640 1 -- 172.21.15.89:0/1850298211 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c02cbd0 con 0x7fa88c14ae30 2023-08-25T09:42:41.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.136+0000 7fa889ffb640 1 -- 172.21.15.89:0/1850298211 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0343f0 con 0x7fa88c14ae30 2023-08-25T09:42:41.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 -- 172.21.15.89:0/1850298211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 msgr2=0x7fa88c14b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:41.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c14b210 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009e50 tx=0x7fa87c02bed0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 -- 172.21.15.89:0/1850298211 shutdown_connections 2023-08-25T09:42:41.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 --2- 172.21.15.89:0/1850298211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c14b210 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 -- 172.21.15.89:0/1850298211 >> 172.21.15.89:0/1850298211 conn(0x7fa88c0b88b0 msgr2=0x7fa88c0b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:41.147 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 -- 172.21.15.89:0/1850298211 shutdown_connections 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.137+0000 7fa891271640 1 -- 172.21.15.89:0/1850298211 wait complete. 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 Processor -- start 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 -- start start 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa88c0b2d00 0x7fa88c1d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:41.148 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c1d3460 con 0x7fa88c14ae30 2023-08-25T09:42:41.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c1428b0 con 0x7fa88c0b2d00 2023-08-25T09:42:41.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa891271640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b3f70 con 0x7fa88c149510 2023-08-25T09:42:41.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa88b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:41.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa88b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c0b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55664/0 (socket says 172.21.15.89:55664) 2023-08-25T09:42:41.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.138+0000 7fa88b7fe640 1 -- 172.21.15.89:0/1427748639 learned_addr learned my addr 172.21.15.89:0/1427748639 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:41.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88a7fc640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:41.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88affd640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa88c0b2d00 0x7fa88c1d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:41.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88b7fe640 1 -- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 msgr2=0x7fa88c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:41.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88b7fe640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88b7fe640 1 -- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa88c0b2d00 msgr2=0x7fa88c1d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:41.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88b7fe640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa88c0b2d00 0x7fa88c1d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:41.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88b7fe640 1 -- 172.21.15.89:0/1427748639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009b30 con 0x7fa88c14ae30 2023-08-25T09:42:41.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88affd640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa88c0b2d00 0x7fa88c1d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:41.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa88b7fe640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c0b4990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa88400d7d0 tx=0x7fa88400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:41.154 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884004030 con 0x7fa88c14ae30 2023-08-25T09:42:41.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884004190 con 0x7fa88c14ae30 2023-08-25T09:42:41.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c142b00 con 0x7fa88c14ae30 2023-08-25T09:42:41.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884004500 con 0x7fa88c14ae30 2023-08-25T09:42:41.155 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.139+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c1d2750 con 0x7fa88c14ae30 2023-08-25T09:42:41.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.140+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c142680 con 0x7fa88c14ae30 2023-08-25T09:42:41.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.140+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa8840096a0 con 0x7fa88c14ae30 2023-08-25T09:42:41.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.141+0000 7fa8737fe640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa87806a080 0x7fa87806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:41.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.141+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa884088510 con 0x7fa88c14ae30 2023-08-25T09:42:41.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.141+0000 7fa88affd640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa87806a080 0x7fa87806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:41.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.141+0000 7fa88affd640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa87806a080 0x7fa87806c540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa87c035000 tx=0x7fa87c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:41.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.145+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa88c142680 con 0x7fa88c14ae30 2023-08-25T09:42:41.316 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:41.313+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa88c142680 con 0x7fa88c14ae30 2023-08-25T09:42:42.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.250+0000 7fa8737fe640 1 -- 172.21.15.89:0/1427748639 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa88c142680 con 0x7fa88c14ae30 2023-08-25T09:42:42.252 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2023-08-25T09:42:42.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.254+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa87806a080 msgr2=0x7fa87806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:42.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.254+0000 7fa891271640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa87806a080 0x7fa87806c540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa87c035000 tx=0x7fa87c030000 comp rx=0 tx=0).stop 2023-08-25T09:42:42.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.254+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 msgr2=0x7fa88c0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:42.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.254+0000 7fa891271640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c0b4990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa88400d7d0 tx=0x7fa88400dc90 comp rx=0 tx=0).stop 2023-08-25T09:42:42.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 shutdown_connections 2023-08-25T09:42:42.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa87806a080 0x7fa87806c540 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa88c14ae30 0x7fa88c0b4990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa88c149510 0x7fa88c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 --2- 172.21.15.89:0/1427748639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa88c0b2d00 0x7fa88c1d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 >> 172.21.15.89:0/1427748639 conn(0x7fa88c0b88b0 msgr2=0x7fa88c06e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:42.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 shutdown_connections 2023-08-25T09:42:42.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.255+0000 7fa891271640 1 -- 172.21.15.89:0/1427748639 wait complete. 2023-08-25T09:42:42.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T09:42:42.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 Processor -- start 2023-08-25T09:42:42.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 -- start start 2023-08-25T09:42:42.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff76006aad0 0x7ff7600b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:42.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff760071bd0 0x7ff76006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:42.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7600b8460 con 0x7ff760144580 2023-08-25T09:42:42.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff760070e40 con 0x7ff76006aad0 2023-08-25T09:42:42.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff766799640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76006fd50 con 0x7ff760071bd0 2023-08-25T09:42:42.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff75ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff76006aad0 0x7ff7600b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:42.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff75ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff76006aad0 0x7ff7600b88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55674/0 (socket says 172.21.15.89:55674) 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.380+0000 7ff75ffff640 1 -- 172.21.15.89:0/2525429751 learned_addr learned my addr 172.21.15.89:0/2525429751 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75f7fe640 1 --2- 172.21.15.89:0/2525429751 >> v2:172.21.15.121:3300/0 conn(0x7ff760071bd0 0x7ff76006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75ffff640 1 -- 172.21.15.89:0/2525429751 >> v2:172.21.15.121:3300/0 conn(0x7ff760071bd0 msgr2=0x7ff76006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75ffff640 1 --2- 172.21.15.89:0/2525429751 >> v2:172.21.15.121:3300/0 conn(0x7ff760071bd0 0x7ff76006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75ffff640 1 -- 172.21.15.89:0/2525429751 >> v1:172.21.15.89:6789/0 conn(0x7ff760144580 legacy=0x7ff7601449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75effd640 1 -- 172.21.15.89:0/2525429751 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950078967 0 0) 0x7ff7600b8460 con 0x7ff760144580 2023-08-25T09:42:42.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75ffff640 1 -- 172.21.15.89:0/2525429751 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76006ff30 con 0x7ff76006aad0 2023-08-25T09:42:42.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.381+0000 7ff75ffff640 1 --2- 172.21.15.89:0/2525429751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff76006aad0 0x7ff7600b88f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff76014b960 tx=0x7ff75402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25136275a334624 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:42.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff75effd640 1 -- 172.21.15.89:0/2525429751 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754030860 con 0x7ff76006aad0 2023-08-25T09:42:42.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff75effd640 1 -- 172.21.15.89:0/2525429751 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540309c0 con 0x7ff76006aad0 2023-08-25T09:42:42.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff75effd640 1 -- 172.21.15.89:0/2525429751 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754030d50 con 0x7ff76006aad0 2023-08-25T09:42:42.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 -- 172.21.15.89:0/2525429751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff76006aad0 msgr2=0x7ff7600b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:42.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 --2- 172.21.15.89:0/2525429751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff76006aad0 0x7ff7600b88f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff76014b960 tx=0x7ff75402b9a0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 -- 172.21.15.89:0/2525429751 shutdown_connections 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 --2- 172.21.15.89:0/2525429751 >> v2:172.21.15.121:3300/0 conn(0x7ff760071bd0 0x7ff76006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 --2- 172.21.15.89:0/2525429751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff76006aad0 0x7ff7600b88f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 -- 172.21.15.89:0/2525429751 >> 172.21.15.89:0/2525429751 conn(0x7ff7600b91c0 msgr2=0x7ff7600b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 -- 172.21.15.89:0/2525429751 shutdown_connections 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.382+0000 7ff766799640 1 -- 172.21.15.89:0/2525429751 wait complete. 2023-08-25T09:42:42.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.383+0000 7ff766799640 1 Processor -- start 2023-08-25T09:42:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.383+0000 7ff766799640 1 -- start start 2023-08-25T09:42:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff766799640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff76006aad0 0x7ff7601476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff766799640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff760071bd0 0x7ff760147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff766799640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 0x7ff760145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff766799640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760145a40 con 0x7ff760144580 2023-08-25T09:42:42.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff766799640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760146fb0 con 0x7ff760071bd0 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff766799640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76014e600 con 0x7ff76006aad0 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 0x7ff760145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 0x7ff760145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55676/0 (socket says 172.21.15.89:55676) 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 -- 172.21.15.89:0/1843255635 learned_addr learned my addr 172.21.15.89:0/1843255635 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff75f7fe640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff760071bd0 0x7ff760147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff75ffff640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff76006aad0 0x7ff7601476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:42.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 -- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff76006aad0 msgr2=0x7ff7601476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff76006aad0 0x7ff7601476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 -- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff760071bd0 msgr2=0x7ff760147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff760071bd0 0x7ff760147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff764d36640 1 -- 172.21.15.89:0/1843255635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540094d0 con 0x7ff760144580 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff75f7fe640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff760071bd0 0x7ff760147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.384+0000 7ff75ffff640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff76006aad0 0x7ff7601476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.385+0000 7ff764d36640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 0x7ff760145500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c740 tx=0x7ff75800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:42.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.385+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758003da0 con 0x7ff760144580 2023-08-25T09:42:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.385+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800ce50 con 0x7ff760144580 2023-08-25T09:42:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.385+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff760146b90 con 0x7ff760144580 2023-08-25T09:42:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.385+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758005290 con 0x7ff760144580 2023-08-25T09:42:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.385+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76014e320 con 0x7ff760144580 2023-08-25T09:42:42.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.386+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76004dc40 con 0x7ff760144580 2023-08-25T09:42:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.386+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff7580053f0 con 0x7ff760144580 2023-08-25T09:42:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.387+0000 7ff75cff9640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff74c06a050 0x7ff74c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:42.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.387+0000 7ff75ffff640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff74c06a050 0x7ff74c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.387+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff758087b10 con 0x7ff760144580 2023-08-25T09:42:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.387+0000 7ff75ffff640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff74c06a050 0x7ff74c06c510 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff754036000 tx=0x7ff754008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:42.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.391+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff758053470 con 0x7ff760144580 2023-08-25T09:42:42.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:42.558+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff760144170 con 0x7ff760144580 2023-08-25T09:42:43.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.257+0000 7ff75cff9640 1 -- 172.21.15.89:0/1843255635 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff758017070 con 0x7ff760144580 2023-08-25T09:42:43.259 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2023-08-25T09:42:43.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.261+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff74c06a050 msgr2=0x7ff74c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:43.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.262+0000 7ff766799640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff74c06a050 0x7ff74c06c510 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff754036000 tx=0x7ff754008030 comp rx=0 tx=0).stop 2023-08-25T09:42:43.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.262+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 msgr2=0x7ff760145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:43.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.262+0000 7ff766799640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 0x7ff760145500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c740 tx=0x7ff75800cc00 comp rx=0 tx=0).stop 2023-08-25T09:42:43.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.263+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 shutdown_connections 2023-08-25T09:42:43.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.263+0000 7ff766799640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff74c06a050 0x7ff74c06c510 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.263+0000 7ff766799640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff760144580 0x7ff760145500 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.263+0000 7ff766799640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff760071bd0 0x7ff760147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.263+0000 7ff766799640 1 --2- 172.21.15.89:0/1843255635 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff76006aad0 0x7ff7601476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.263+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 >> 172.21.15.89:0/1843255635 conn(0x7ff7600b91c0 msgr2=0x7ff7600b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:43.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.264+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 shutdown_connections 2023-08-25T09:42:43.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.264+0000 7ff766799640 1 -- 172.21.15.89:0/1843255635 wait complete. 2023-08-25T09:42:43.283 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T09:42:43.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.387+0000 7fc1808d3640 1 Processor -- start 2023-08-25T09:42:43.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.387+0000 7fc1808d3640 1 -- start start 2023-08-25T09:42:43.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc1808d3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c06aad0 0x7fc17c0b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:43.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc1808d3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc17c071bd0 0x7fc17c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:43.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc1808d3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0b8460 con 0x7fc17c144580 2023-08-25T09:42:43.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc1808d3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c070e40 con 0x7fc17c071bd0 2023-08-25T09:42:43.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc1808d3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c06fd50 con 0x7fc17c06aad0 2023-08-25T09:42:43.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc17c071bd0 0x7fc17c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:43.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc17c071bd0 0x7fc17c06ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55678/0 (socket says 172.21.15.89:55678) 2023-08-25T09:42:43.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 -- 172.21.15.89:0/3036873619 learned_addr learned my addr 172.21.15.89:0/3036873619 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:43.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc17a59c640 1 --2- 172.21.15.89:0/3036873619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c06aad0 0x7fc17c0b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:43.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 -- 172.21.15.89:0/3036873619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c06aad0 msgr2=0x7fc17c0b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:43.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 --2- 172.21.15.89:0/3036873619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c06aad0 0x7fc17c0b88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 -- 172.21.15.89:0/3036873619 >> v1:172.21.15.121:6789/0 conn(0x7fc17c144580 legacy=0x7fc17c14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:43.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.388+0000 7fc173fff640 1 -- 172.21.15.89:0/3036873619 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c06ff30 con 0x7fc17c071bd0 2023-08-25T09:42:43.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc173fff640 1 --2- 172.21.15.89:0/3036873619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c071bd0 0x7fc17c06ef80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098a0 tx=0x7fc16402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be6d3976f0177a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:43.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc179d9b640 1 -- 172.21.15.89:0/3036873619 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164031640 con 0x7fc17c071bd0 2023-08-25T09:42:43.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc179d9b640 1 -- 172.21.15.89:0/3036873619 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640317a0 con 0x7fc17c071bd0 2023-08-25T09:42:43.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc179d9b640 1 -- 172.21.15.89:0/3036873619 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164031b30 con 0x7fc17c071bd0 2023-08-25T09:42:43.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 -- 172.21.15.89:0/3036873619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c071bd0 msgr2=0x7fc17c06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:43.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3036873619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c071bd0 0x7fc17c06ef80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098a0 tx=0x7fc16402b8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 -- 172.21.15.89:0/3036873619 shutdown_connections 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3036873619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c071bd0 0x7fc17c06ef80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3036873619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c06aad0 0x7fc17c0b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 -- 172.21.15.89:0/3036873619 >> 172.21.15.89:0/3036873619 conn(0x7fc17c0b91c0 msgr2=0x7fc17c0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 -- 172.21.15.89:0/3036873619 shutdown_connections 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.389+0000 7fc1808d3640 1 -- 172.21.15.89:0/3036873619 wait complete. 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 Processor -- start 2023-08-25T09:42:43.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 -- start start 2023-08-25T09:42:43.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 0x7fc17c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:43.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc17c071bd0 0x7fc17c0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:43.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c144580 0x7fc17c1429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:43.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ac470 con 0x7fc17c06aad0 2023-08-25T09:42:43.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ad4e0 con 0x7fc17c071bd0 2023-08-25T09:42:43.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc1808d3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0b54f0 con 0x7fc17c144580 2023-08-25T09:42:43.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc17a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 0x7fc17c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:43.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc17a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 0x7fc17c0abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55684/0 (socket says 172.21.15.89:55684) 2023-08-25T09:42:43.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc17a59c640 1 -- 172.21.15.89:0/3873337516 learned_addr learned my addr 172.21.15.89:0/3873337516 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:43.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc17ad9d640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c144580 0x7fc17c1429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:43.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.391+0000 7fc173fff640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc17c071bd0 0x7fc17c0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:43.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17a59c640 1 -- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c144580 msgr2=0x7fc17c1429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:43.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17a59c640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c144580 0x7fc17c1429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17a59c640 1 -- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc17c071bd0 msgr2=0x7fc17c0ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:43.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17a59c640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc17c071bd0 0x7fc17c0ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:43.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17a59c640 1 -- 172.21.15.89:0/3873337516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640094d0 con 0x7fc17c06aad0 2023-08-25T09:42:43.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17ad9d640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c144580 0x7fc17c1429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:43.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc17a59c640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 0x7fc17c0abf30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c820 tx=0x7fc16c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:43.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c004220 con 0x7fc17c06aad0 2023-08-25T09:42:43.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0043a0 con 0x7fc17c06aad0 2023-08-25T09:42:43.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c0acee0 con 0x7fc17c06aad0 2023-08-25T09:42:43.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c007a70 con 0x7fc17c06aad0 2023-08-25T09:42:43.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.392+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c0b5a70 con 0x7fc17c06aad0 2023-08-25T09:42:43.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.393+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c0ad670 con 0x7fc17c06aad0 2023-08-25T09:42:43.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.393+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc16c007bd0 con 0x7fc17c06aad0 2023-08-25T09:42:43.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.394+0000 7fc172ffd640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc15c06a080 0x7fc15c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:43.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.394+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc16c088240 con 0x7fc17c06aad0 2023-08-25T09:42:43.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.394+0000 7fc173fff640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc15c06a080 0x7fc15c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:43.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.394+0000 7fc173fff640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc15c06a080 0x7fc15c06c540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc164036000 tx=0x7fc16403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:43.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.398+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc16c053a20 con 0x7fc17c06aad0 2023-08-25T09:42:43.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:43.601+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc17c04dc40 con 0x7fc17c06aad0 2023-08-25T09:42:44.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.258+0000 7fc172ffd640 1 -- 172.21.15.89:0/3873337516 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc16c057040 con 0x7fc17c06aad0 2023-08-25T09:42:44.261 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 5 and data pool 6 2023-08-25T09:42:44.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.266+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc15c06a080 msgr2=0x7fc15c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.266+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc15c06a080 0x7fc15c06c540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc164036000 tx=0x7fc16403c040 comp rx=0 tx=0).stop 2023-08-25T09:42:44.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.266+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 msgr2=0x7fc17c0abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.266+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 0x7fc17c0abf30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c820 tx=0x7fc16c00cce0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.267+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 shutdown_connections 2023-08-25T09:42:44.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.267+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fc15c06a080 0x7fc15c06c540 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.267+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc17c144580 0x7fc17c1429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.267+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc17c071bd0 0x7fc17c0ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.267+0000 7fc1808d3640 1 --2- 172.21.15.89:0/3873337516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc17c06aad0 0x7fc17c0abf30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.267+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 >> 172.21.15.89:0/3873337516 conn(0x7fc17c0b91c0 msgr2=0x7fc17c0b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:44.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.269+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 shutdown_connections 2023-08-25T09:42:44.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.270+0000 7fc1808d3640 1 -- 172.21.15.89:0/3873337516 wait complete. 2023-08-25T09:42:44.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:44.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.389+0000 7f6c756c5640 1 Processor -- start 2023-08-25T09:42:44.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.389+0000 7f6c756c5640 1 -- start start 2023-08-25T09:42:44.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c756c5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6c70144c40 0x7f6c700bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c756c5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c700b6ec0 0x7f6c700b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c756c5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c7014e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c756c5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c70145020 con 0x7f6c700b6ec0 2023-08-25T09:42:44.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c756c5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700b9330 con 0x7f6c70144c40 2023-08-25T09:42:44.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c756c5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700bd290 con 0x7f6c7014ddb0 2023-08-25T09:42:44.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c700b6ec0 0x7f6c700b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c700b6ec0 0x7f6c700b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55696/0 (socket says 172.21.15.89:55696) 2023-08-25T09:42:44.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 -- 172.21.15.89:0/3800569487 learned_addr learned my addr 172.21.15.89:0/3800569487 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:44.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 -- 172.21.15.89:0/3800569487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 msgr2=0x7f6c7014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c6f7fe640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c7014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c7014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c6effd640 1 --2- 172.21.15.89:0/3800569487 >> v2:172.21.15.121:3300/0 conn(0x7f6c70144c40 0x7f6c700bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 -- 172.21.15.89:0/3800569487 >> v2:172.21.15.121:3300/0 conn(0x7f6c70144c40 msgr2=0x7f6c700bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 --2- 172.21.15.89:0/3800569487 >> v2:172.21.15.121:3300/0 conn(0x7f6c70144c40 0x7f6c700bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c67fff640 1 -- 172.21.15.89:0/3800569487 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700b8850 con 0x7f6c700b6ec0 2023-08-25T09:42:44.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c6f7fe640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c7014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:44.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.390+0000 7f6c6effd640 1 --2- 172.21.15.89:0/3800569487 >> v2:172.21.15.121:3300/0 conn(0x7f6c70144c40 0x7f6c700bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:44.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c67fff640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b7660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c7006c1a0 tx=0x7f6c5802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771c3edb6256405f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c6e7fc640 1 -- 172.21.15.89:0/3800569487 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58031860 con 0x7f6c700b6ec0 2023-08-25T09:42:44.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c6e7fc640 1 -- 172.21.15.89:0/3800569487 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c580319c0 con 0x7f6c700b6ec0 2023-08-25T09:42:44.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c6e7fc640 1 -- 172.21.15.89:0/3800569487 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58031d50 con 0x7f6c700b6ec0 2023-08-25T09:42:44.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 -- 172.21.15.89:0/3800569487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c700b6ec0 msgr2=0x7f6c700b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b7660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c7006c1a0 tx=0x7f6c5802b900 comp rx=0 tx=0).stop 2023-08-25T09:42:44.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 -- 172.21.15.89:0/3800569487 shutdown_connections 2023-08-25T09:42:44.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c7014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3800569487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b7660 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3800569487 >> v2:172.21.15.121:3300/0 conn(0x7f6c70144c40 0x7f6c700bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.391+0000 7f6c756c5640 1 -- 172.21.15.89:0/3800569487 >> 172.21.15.89:0/3800569487 conn(0x7f6c700654f0 msgr2=0x7f6c700658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:44.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.392+0000 7f6c756c5640 1 -- 172.21.15.89:0/3800569487 shutdown_connections 2023-08-25T09:42:44.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.392+0000 7f6c756c5640 1 -- 172.21.15.89:0/3800569487 wait complete. 2023-08-25T09:42:44.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 Processor -- start 2023-08-25T09:42:44.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 -- start start 2023-08-25T09:42:44.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 0x7f6c700c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c701e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700b4c20 con 0x7f6c70144c40 2023-08-25T09:42:44.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70148870 con 0x7f6c700b6ec0 2023-08-25T09:42:44.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c756c5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70148e30 con 0x7f6c7014ddb0 2023-08-25T09:42:44.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c67fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 0x7f6c700c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c67fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 0x7f6c700c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55708/0 (socket says 172.21.15.89:55708) 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c67fff640 1 -- 172.21.15.89:0/3183496718 learned_addr learned my addr 172.21.15.89:0/3183496718 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c6f7fe640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c701e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c6effd640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c67fff640 1 -- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 msgr2=0x7f6c701e2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.393+0000 7f6c67fff640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c701e2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c67fff640 1 -- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c700b6ec0 msgr2=0x7f6c700b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c67fff640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c67fff640 1 -- 172.21.15.89:0/3183496718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580094d0 con 0x7f6c70144c40 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c6f7fe640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c701e2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c6effd640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c67fff640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 0x7f6c700c0870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c5802b940 tx=0x7f6c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58031850 con 0x7f6c70144c40 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c580443f0 con 0x7f6c70144c40 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c700bff00 con 0x7f6c70144c40 2023-08-25T09:42:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580447a0 con 0x7f6c70144c40 2023-08-25T09:42:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.394+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7014a590 con 0x7f6c70144c40 2023-08-25T09:42:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.395+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c70073bf0 con 0x7f6c70144c40 2023-08-25T09:42:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.395+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c5804d450 con 0x7f6c70144c40 2023-08-25T09:42:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.396+0000 7f6c677fe640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6c5006a080 0x7f6c5006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.396+0000 7f6c6effd640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6c5006a080 0x7f6c5006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.396+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c580aad00 con 0x7f6c70144c40 2023-08-25T09:42:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.396+0000 7f6c6effd640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6c5006a080 0x7f6c5006c540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c60006b10 tx=0x7f6c60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.400+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6c580763f0 con 0x7f6c70144c40 2023-08-25T09:42:44.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.568+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c700bc3d0 con 0x7f6c70144c40 2023-08-25T09:42:44.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.569+0000 7f6c677fe640 1 -- 172.21.15.89:0/3183496718 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f6c58035070 con 0x7f6c70144c40 2023-08-25T09:42:44.571 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:44.572 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:43.602110+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:42:41.332292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T09:42:42.577019+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:44.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6c5006a080 msgr2=0x7f6c5006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6c5006a080 0x7f6c5006c540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c60006b10 tx=0x7f6c60008040 comp rx=0 tx=0).stop 2023-08-25T09:42:44.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 msgr2=0x7f6c700c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 0x7f6c700c0870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c5802b940 tx=0x7f6c580046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 shutdown_connections 2023-08-25T09:42:44.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6c5006a080 0x7f6c5006c540 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c70144c40 0x7f6c700c0870 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c7014ddb0 0x7f6c701e2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 --2- 172.21.15.89:0/3183496718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c700b6ec0 0x7f6c700b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 >> 172.21.15.89:0/3183496718 conn(0x7f6c700654f0 msgr2=0x7f6c701430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:44.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 shutdown_connections 2023-08-25T09:42:44.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.572+0000 7f6c756c5640 1 -- 172.21.15.89:0/3183496718 wait complete. 2023-08-25T09:42:44.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:44.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 Processor -- start 2023-08-25T09:42:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 -- start start 2023-08-25T09:42:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 0x7f43bc0be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f43bc0b3990 0x7f43bc0a5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc0be5b0 con 0x7f43bc0bfcf0 2023-08-25T09:42:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc06a390 con 0x7f43bc0b3990 2023-08-25T09:42:44.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43c121f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0bf5c0 con 0x7f43bc0bae60 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43bb59e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f43bc0bfcf0 0x7f43bc0a5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57690/0 (socket says 172.21.15.89:57690) 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.684+0000 7f43bb59e640 1 -- 172.21.15.89:0/92139953 learned_addr learned my addr 172.21.15.89:0/92139953 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830523098 0 0) 0x7f43bc0be5b0 con 0x7f43bc0bfcf0 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a4003520 con 0x7f43bc0bfcf0 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43bad9d640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 0x7f43bc0be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 --2- 172.21.15.89:0/92139953 >> v2:172.21.15.121:3300/0 conn(0x7f43bc0b3990 0x7f43bc0a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3483013763 0 0) 0x7f43a4003520 con 0x7f43bc0bfcf0 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 msgr2=0x7f43bc0be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 0x7f43bc0be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 >> v2:172.21.15.121:3300/0 conn(0x7f43bc0b3990 msgr2=0x7f43bc0a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 --2- 172.21.15.89:0/92139953 >> v2:172.21.15.121:3300/0 conn(0x7f43bc0b3990 0x7f43bc0a5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc06a580 con 0x7f43bc0bfcf0 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f43b40019f0 con 0x7f43bc0bfcf0 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 >> v1:172.21.15.89:6789/0 conn(0x7f43bc0bfcf0 legacy=0x7f43bc0a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40039e0 0x7f43a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 0x7f43a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0bf5c0 con 0x7f43a40047c0 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400ba30 con 0x7f43a40039e0 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a400bbf0 con 0x7f43bc0bae60 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 --2- 172.21.15.89:0/92139953 >> v2:172.21.15.121:3300/0 conn(0x7f43bc0b3990 0x7f43bc0a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:44.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43bb59e640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 0x7f43a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43bad9d640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40039e0 0x7f43a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 -- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 msgr2=0x7f43a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc0bae60 0x7f43a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 -- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40039e0 msgr2=0x7f43a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40039e0 0x7f43a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43ba59c640 1 -- 172.21.15.89:0/92139953 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4003520 con 0x7f43a40047c0 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.685+0000 7f43bad9d640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40039e0 0x7f43a4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.686+0000 7f43ba59c640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f43b0006fd0 tx=0x7f43a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04269b44f4c5b9b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.686+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0030400 con 0x7f43a40047c0 2023-08-25T09:42:44.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.686+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b0030560 con 0x7f43a40047c0 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.686+0000 7f43b9d9b640 1 -- 172.21.15.89:0/92139953 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00308d0 con 0x7f43a40047c0 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43c121f640 1 -- 172.21.15.89:0/92139953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a40047c0 msgr2=0x7f43a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43c121f640 1 --2- 172.21.15.89:0/92139953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43a40047c0 0x7f43a4004c40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f43b0006fd0 tx=0x7f43a40057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43bb59e640 1 -- 172.21.15.89:0/92139953 reap_dead start 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43c121f640 1 -- 172.21.15.89:0/92139953 shutdown_connections 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43c121f640 1 -- 172.21.15.89:0/92139953 >> 172.21.15.89:0/92139953 conn(0x7f43bc0c0270 msgr2=0x7f43bc0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43c121f640 1 -- 172.21.15.89:0/92139953 shutdown_connections 2023-08-25T09:42:44.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.687+0000 7f43c121f640 1 -- 172.21.15.89:0/92139953 wait complete. 2023-08-25T09:42:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.688+0000 7f43c121f640 1 Processor -- start 2023-08-25T09:42:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.688+0000 7f43c121f640 1 -- start start 2023-08-25T09:42:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40047c0 0x7f43bc0b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 0x7f43bc14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc1e2eb0 0x7f43bc1e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0b6bd0 con 0x7f43bc0b6180 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0ba490 con 0x7f43a40047c0 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc14dc50 con 0x7f43bc1e2eb0 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 0x7f43bc14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 0x7f43bc14e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55724/0 (socket says 172.21.15.89:55724) 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 -- 172.21.15.89:0/681926996 learned_addr learned my addr 172.21.15.89:0/681926996 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43bb59e640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc1e2eb0 0x7f43bc1e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43bad9d640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40047c0 0x7f43bc0b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 -- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc1e2eb0 msgr2=0x7f43bc1e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc1e2eb0 0x7f43bc1e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 -- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40047c0 msgr2=0x7f43bc0b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40047c0 0x7f43bc0b9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 -- 172.21.15.89:0/681926996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0b6610 con 0x7f43bc0b6180 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43ba59c640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 0x7f43bc14e0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f43b002bf60 tx=0x7f43b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b003e040 con 0x7f43bc0b6180 2023-08-25T09:42:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b0039a20 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc0b68f0 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0039dd0 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.689+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc14e940 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.690+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc14da20 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.691+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43b00423e0 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.691+0000 7f43a37fe640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f43a806a080 0x7f43a806c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.691+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43b00aa370 con 0x7f43bc0b6180 2023-08-25T09:42:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.691+0000 7f43bad9d640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f43a806a080 0x7f43a806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.692+0000 7f43bad9d640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f43a806a080 0x7f43a806c540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43ac006f80 tx=0x7f43ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.695+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43bc14da20 con 0x7f43bc0b6180 2023-08-25T09:42:44.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.865+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43bc14da20 con 0x7f43bc0b6180 2023-08-25T09:42:44.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.867+0000 7f43a37fe640 1 -- 172.21.15.89:0/681926996 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f43bc14da20 con 0x7f43bc0b6180 2023-08-25T09:42:44.869 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:44.869 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:43.602110+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:42:41.332292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T09:42:42.577019+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:44.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.868+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f43a806a080 msgr2=0x7f43a806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.868+0000 7f43c121f640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f43a806a080 0x7f43a806c540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43ac006f80 tx=0x7f43ac008040 comp rx=0 tx=0).stop 2023-08-25T09:42:44.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.868+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 msgr2=0x7f43bc14e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.868+0000 7f43c121f640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 0x7f43bc14e0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f43b002bf60 tx=0x7f43b00046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 shutdown_connections 2023-08-25T09:42:44.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f43a806a080 0x7f43a806c540 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43bc0b6180 0x7f43bc14e0e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43bc1e2eb0 0x7f43bc1e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 --2- 172.21.15.89:0/681926996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43a40047c0 0x7f43bc0b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 >> 172.21.15.89:0/681926996 conn(0x7f43bc0c0270 msgr2=0x7f43bc0bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:44.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 shutdown_connections 2023-08-25T09:42:44.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.869+0000 7f43c121f640 1 -- 172.21.15.89:0/681926996 wait complete. 2023-08-25T09:42:44.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T09:42:44.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.982+0000 7f55a01e1640 1 Processor -- start 2023-08-25T09:42:44.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.982+0000 7f55a01e1640 1 -- start start 2023-08-25T09:42:44.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f55a01e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55980b7b80 0x7f55980b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f55a01e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 0x7f5598141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f55a01e1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559806e880 con 0x7f5598070810 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f55a01e1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55980b3570 con 0x7f55980b7b80 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f55a01e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55980b3000 con 0x7f55981415c0 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 0x7f5598141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559df7d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55980b7b80 0x7f55980b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 0x7f5598141a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:44380/0 (socket says 172.21.15.89:44380) 2023-08-25T09:42:44.987 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 -- 172.21.15.89:0/1812889622 learned_addr learned my addr 172.21.15.89:0/1812889622 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 -- 172.21.15.89:0/1812889622 >> v2:172.21.15.121:3300/0 conn(0x7f55980b7b80 msgr2=0x7f55980b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 --2- 172.21.15.89:0/1812889622 >> v2:172.21.15.121:3300/0 conn(0x7f55980b7b80 0x7f55980b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 -- 172.21.15.89:0/1812889622 >> v1:172.21.15.121:6789/0 conn(0x7f5598070810 legacy=0x7f5598069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.983+0000 7f559d77c640 1 -- 172.21.15.89:0/1812889622 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559814ab90 con 0x7f55981415c0 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.984+0000 7f559d77c640 1 --2- 172.21.15.89:0/1812889622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 0x7f5598141a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f558802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1b39198416ce9a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.984+0000 7f559cf7b640 1 -- 172.21.15.89:0/1812889622 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588030840 con 0x7f55981415c0 2023-08-25T09:42:44.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.984+0000 7f559cf7b640 1 -- 172.21.15.89:0/1812889622 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880309a0 con 0x7f55981415c0 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.984+0000 7f559cf7b640 1 -- 172.21.15.89:0/1812889622 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588030d30 con 0x7f55981415c0 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 -- 172.21.15.89:0/1812889622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 msgr2=0x7f5598141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 --2- 172.21.15.89:0/1812889622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 0x7f5598141a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f558802b980 comp rx=0 tx=0).stop 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 -- 172.21.15.89:0/1812889622 shutdown_connections 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 --2- 172.21.15.89:0/1812889622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55981415c0 0x7f5598141a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 --2- 172.21.15.89:0/1812889622 >> v2:172.21.15.121:3300/0 conn(0x7f55980b7b80 0x7f55980b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 -- 172.21.15.89:0/1812889622 >> 172.21.15.89:0/1812889622 conn(0x7f55980bbe80 msgr2=0x7f55980bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:44.989 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 -- 172.21.15.89:0/1812889622 shutdown_connections 2023-08-25T09:42:44.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.985+0000 7f55a01e1640 1 -- 172.21.15.89:0/1812889622 wait complete. 2023-08-25T09:42:44.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 Processor -- start 2023-08-25T09:42:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 -- start start 2023-08-25T09:42:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5598070810 0x7f55980b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55980b7b80 0x7f559814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 0x7f55981e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559814a7d0 con 0x7f55981415c0 2023-08-25T09:42:44.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55980b4bd0 con 0x7f55980b7b80 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f55a01e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5598135b70 con 0x7f5598070810 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f559e77e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 0x7f55981e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f559e77e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 0x7f55981e1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55736/0 (socket says 172.21.15.89:55736) 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f559e77e640 1 -- 172.21.15.89:0/3486833671 learned_addr learned my addr 172.21.15.89:0/3486833671 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f559df7d640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5598070810 0x7f55980b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.986+0000 7f559d77c640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55980b7b80 0x7f559814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.993 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f559e77e640 1 -- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5598070810 msgr2=0x7f55980b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f559e77e640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5598070810 0x7f55980b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f559e77e640 1 -- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55980b7b80 msgr2=0x7f559814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f559e77e640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55980b7b80 0x7f559814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f559e77e640 1 -- 172.21.15.89:0/3486833671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880094d0 con 0x7f55981415c0 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f559e77e640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 0x7f55981e1250 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f559000c7d0 tx=0x7f559000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590003b70 con 0x7f55981415c0 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590003cf0 con 0x7f55981415c0 2023-08-25T09:42:44.994 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5598136000 con 0x7f55981415c0 2023-08-25T09:42:44.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559000aa90 con 0x7f55981415c0 2023-08-25T09:42:44.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.987+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55980b5f60 con 0x7f55981415c0 2023-08-25T09:42:44.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.988+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559804dc40 con 0x7f55981415c0 2023-08-25T09:42:44.995 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.988+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f559000abf0 con 0x7f55981415c0 2023-08-25T09:42:44.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.989+0000 7f558e7fc640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f557c06a050 0x7f557c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:44.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.989+0000 7f559df7d640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f557c06a050 0x7f557c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:44.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.989+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5590088230 con 0x7f55981415c0 2023-08-25T09:42:44.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.989+0000 7f559df7d640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f557c06a050 0x7f557c06c510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5594009b40 tx=0x7f5594009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:44.996 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:44.993+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f55900539e0 con 0x7f55981415c0 2023-08-25T09:42:45.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.195+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f559806e660 con 0x7f55981415c0 2023-08-25T09:42:45.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.267+0000 7f558e7fc640 1 -- 172.21.15.89:0/3486833671 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5590003e60 con 0x7f55981415c0 2023-08-25T09:42:45.271 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f557c06a050 msgr2=0x7f557c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:45.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f557c06a050 0x7f557c06c510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5594009b40 tx=0x7f5594009190 comp rx=0 tx=0).stop 2023-08-25T09:42:45.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 msgr2=0x7f55981e1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:45.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 0x7f55981e1250 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f559000c7d0 tx=0x7f559000cc90 comp rx=0 tx=0).stop 2023-08-25T09:42:45.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 shutdown_connections 2023-08-25T09:42:45.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f557c06a050 0x7f557c06c510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.272 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55981415c0 0x7f55981e1250 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55980b7b80 0x7f559814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 --2- 172.21.15.89:0/3486833671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5598070810 0x7f55980b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 >> 172.21.15.89:0/3486833671 conn(0x7f55980bbe80 msgr2=0x7f55980b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:45.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 shutdown_connections 2023-08-25T09:42:45.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.269+0000 7f55a01e1640 1 -- 172.21.15.89:0/3486833671 wait complete. 2023-08-25T09:42:45.282 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T09:42:45.283 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T09:42:45.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 Processor -- start 2023-08-25T09:42:45.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 -- start start 2023-08-25T09:42:45.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5d740b7b80 0x7f5d740b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:45.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d741415c0 0x7f5d74141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:45.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7406e880 con 0x7f5d74070810 2023-08-25T09:42:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740b3570 con 0x7f5d741415c0 2023-08-25T09:42:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.383+0000 7f5d7b3c2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740b3000 con 0x7f5d740b7b80 2023-08-25T09:42:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d741415c0 0x7f5d74141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d741415c0 0x7f5d74141a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55746/0 (socket says 172.21.15.89:55746) 2023-08-25T09:42:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 -- 172.21.15.89:0/1598468015 learned_addr learned my addr 172.21.15.89:0/1598468015 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7915e640 1 --2- 172.21.15.89:0/1598468015 >> v2:172.21.15.121:3300/0 conn(0x7f5d740b7b80 0x7f5d740b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 -- 172.21.15.89:0/1598468015 >> v2:172.21.15.121:3300/0 conn(0x7f5d740b7b80 msgr2=0x7f5d740b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 --2- 172.21.15.89:0/1598468015 >> v2:172.21.15.121:3300/0 conn(0x7f5d740b7b80 0x7f5d740b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 -- 172.21.15.89:0/1598468015 >> v1:172.21.15.121:6789/0 conn(0x7f5d74070810 legacy=0x7f5d74069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.384+0000 7f5d7895d640 1 -- 172.21.15.89:0/1598468015 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7414ab90 con 0x7f5d741415c0 2023-08-25T09:42:45.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7895d640 1 --2- 172.21.15.89:0/1598468015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d741415c0 0x7f5d74141a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5d740b8540 tx=0x7f5d6402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd07ae69927b77bb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:45.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d6bfff640 1 -- 172.21.15.89:0/1598468015 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640317c0 con 0x7f5d741415c0 2023-08-25T09:42:45.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d6bfff640 1 -- 172.21.15.89:0/1598468015 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64031920 con 0x7f5d741415c0 2023-08-25T09:42:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d6bfff640 1 -- 172.21.15.89:0/1598468015 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64031cb0 con 0x7f5d741415c0 2023-08-25T09:42:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/1598468015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d741415c0 msgr2=0x7f5d74141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/1598468015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d741415c0 0x7f5d74141a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5d740b8540 tx=0x7f5d6402b860 comp rx=0 tx=0).stop 2023-08-25T09:42:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/1598468015 shutdown_connections 2023-08-25T09:42:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/1598468015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d741415c0 0x7f5d74141a00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/1598468015 >> v2:172.21.15.121:3300/0 conn(0x7f5d740b7b80 0x7f5d740b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/1598468015 >> 172.21.15.89:0/1598468015 conn(0x7f5d740bbe80 msgr2=0x7f5d740bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/1598468015 shutdown_connections 2023-08-25T09:42:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.385+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/1598468015 wait complete. 2023-08-25T09:42:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.386+0000 7f5d7b3c2640 1 Processor -- start 2023-08-25T09:42:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.386+0000 7f5d7b3c2640 1 -- start start 2023-08-25T09:42:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7b3c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 0x7f5d741db070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7b3c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d740b7b80 0x7f5d740b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7b3c2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d741415c0 0x7f5d7412db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7b3c2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d740b4eb0 con 0x7f5d74070810 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7b3c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741449c0 con 0x7f5d740b7b80 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7b3c2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741db5b0 con 0x7f5d741415c0 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 0x7f5d741db070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 0x7f5d741db070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55756/0 (socket says 172.21.15.89:55756) 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 -- 172.21.15.89:0/484717652 learned_addr learned my addr 172.21.15.89:0/484717652 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 -- 172.21.15.89:0/484717652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d741415c0 msgr2=0x7f5d7412db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d741415c0 0x7f5d7412db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 -- 172.21.15.89:0/484717652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d740b7b80 msgr2=0x7f5d740b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d740b7b80 0x7f5d740b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 -- 172.21.15.89:0/484717652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640094d0 con 0x7f5d74070810 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.387+0000 7f5d7915e640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 0x7f5d741db070 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000d830 tx=0x7f5d7000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.388+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000b6c0 con 0x7f5d74070810 2023-08-25T09:42:45.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.388+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000b820 con 0x7f5d74070810 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.388+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d741db820 con 0x7f5d74070810 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.388+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000bb90 con 0x7f5d74070810 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.388+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d74144c10 con 0x7f5d74070810 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.389+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5d7001e460 con 0x7f5d74070810 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.389+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7404dc40 con 0x7f5d74070810 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.389+0000 7f5d69ffb640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5d5806a050 0x7f5d5806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:45.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.389+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d70088d90 con 0x7f5d74070810 2023-08-25T09:42:45.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.389+0000 7f5d7895d640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5d5806a050 0x7f5d5806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:45.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.390+0000 7f5d7895d640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5d5806a050 0x7f5d5806c510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d64036000 tx=0x7f5d64030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:45.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.393+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5d70054480 con 0x7f5d74070810 2023-08-25T09:42:45.596 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:45.594+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d740b76f0 con 0x7f5d74070810 2023-08-25T09:42:46.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.278+0000 7f5d69ffb640 1 -- 172.21.15.89:0/484717652 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d70057aa0 con 0x7f5d74070810 2023-08-25T09:42:46.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5d5806a050 msgr2=0x7f5d5806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5d5806a050 0x7f5d5806c510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d64036000 tx=0x7f5d64030000 comp rx=0 tx=0).stop 2023-08-25T09:42:46.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 msgr2=0x7f5d741db070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 0x7f5d741db070 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000d830 tx=0x7f5d7000dcf0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 shutdown_connections 2023-08-25T09:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f5d5806a050 0x7f5d5806c510 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d741415c0 0x7f5d7412db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d740b7b80 0x7f5d740b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 --2- 172.21.15.89:0/484717652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d74070810 0x7f5d741db070 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 >> 172.21.15.89:0/484717652 conn(0x7f5d740bbe80 msgr2=0x7f5d740b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:46.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 shutdown_connections 2023-08-25T09:42:46.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.281+0000 7f5d7b3c2640 1 -- 172.21.15.89:0/484717652 wait complete. 2023-08-25T09:42:46.295 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T09:42:46.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:46.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.398+0000 7f786f355640 1 Processor -- start 2023-08-25T09:42:46.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786f355640 1 -- start start 2023-08-25T09:42:46.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786f355640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f78681429b0 0x7f78680b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786f355640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78680b5f00 con 0x7f78680badd0 2023-08-25T09:42:46.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786f355640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78680b5c20 con 0x7f78681486d0 2023-08-25T09:42:46.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786f355640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786814bdd0 con 0x7f78681429b0 2023-08-25T09:42:46.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786d0f1640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f78680badd0 0x7f786814c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40718/0 (socket says 172.21.15.89:40718) 2023-08-25T09:42:46.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.399+0000 7f786d0f1640 1 -- 172.21.15.89:0/61277502 learned_addr learned my addr 172.21.15.89:0/61277502 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:46.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081558599 0 0) 0x7f78680b5f00 con 0x7f78680badd0 2023-08-25T09:42:46.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d8f2640 1 --2- 172.21.15.89:0/61277502 >> v2:172.21.15.121:3300/0 conn(0x7f78681429b0 0x7f78680b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7854003520 con 0x7f78680badd0 2023-08-25T09:42:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620956037 0 0) 0x7f7854003520 con 0x7f78680badd0 2023-08-25T09:42:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 >> v2:172.21.15.121:3300/0 conn(0x7f78681429b0 msgr2=0x7f78680b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 --2- 172.21.15.89:0/61277502 >> v2:172.21.15.121:3300/0 conn(0x7f78681429b0 0x7f78680b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 >> v1:172.21.15.121:6789/0 conn(0x7f78681486d0 legacy=0x7f78681422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786814c0b0 con 0x7f78680badd0 2023-08-25T09:42:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f78640019f0 con 0x7f78680badd0 2023-08-25T09:42:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 >> v1:172.21.15.89:6789/0 conn(0x7f78680badd0 legacy=0x7f786814c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78540039e0 0x7f7854003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540047c0 0x7f7854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7854005180 0x7f785400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786814bdd0 con 0x7f78540039e0 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785400c0b0 con 0x7f7854005180 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785400c270 con 0x7f78540047c0 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d0f1640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78540039e0 0x7f7854003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786c8f0640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540047c0 0x7f7854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d8f2640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7854005180 0x7f785400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d0f1640 1 -- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540047c0 msgr2=0x7f7854004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d0f1640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540047c0 0x7f7854004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d0f1640 1 -- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7854005180 msgr2=0x7f785400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d0f1640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7854005180 0x7f785400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d0f1640 1 -- 172.21.15.89:0/61277502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854003520 con 0x7f78540039e0 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.400+0000 7f786d8f2640 1 -- 172.21.15.89:0/61277502 reap_dead start 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.401+0000 7f786d0f1640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78540039e0 0x7f7854003e00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f786400a830 tx=0x7f78540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c643cb6f00b5f6f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.401+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640072d0 con 0x7f78540039e0 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.401+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786402f070 con 0x7f78540039e0 2023-08-25T09:42:46.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.401+0000 7f785ffff640 1 -- 172.21.15.89:0/61277502 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640076f0 con 0x7f78540039e0 2023-08-25T09:42:46.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 -- 172.21.15.89:0/61277502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78540039e0 msgr2=0x7f7854003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78540039e0 0x7f7854003e00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f786400a830 tx=0x7f78540057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 -- 172.21.15.89:0/61277502 shutdown_connections 2023-08-25T09:42:46.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 --2- 172.21.15.89:0/61277502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78540039e0 0x7f7854003e00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 -- 172.21.15.89:0/61277502 >> 172.21.15.89:0/61277502 conn(0x7f78680654f0 msgr2=0x7f7868065900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:46.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 -- 172.21.15.89:0/61277502 shutdown_connections 2023-08-25T09:42:46.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.402+0000 7f786f355640 1 -- 172.21.15.89:0/61277502 wait complete. 2023-08-25T09:42:46.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 Processor -- start 2023-08-25T09:42:46.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 -- start start 2023-08-25T09:42:46.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540039e0 0x7f78681461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7868144250 0x7f78681e0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 0x7f78681e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681466f0 con 0x7f78681446b0 2023-08-25T09:42:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681e1930 con 0x7f7868144250 2023-08-25T09:42:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786f355640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680b4460 con 0x7f78540039e0 2023-08-25T09:42:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786d8f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 0x7f78681e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.403+0000 7f786d8f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 0x7f78681e13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35132/0 (socket says 172.21.15.89:35132) 2023-08-25T09:42:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 -- 172.21.15.89:0/2283939669 learned_addr learned my addr 172.21.15.89:0/2283939669 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:46.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d0f1640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540039e0 0x7f78681461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786c8f0640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7868144250 0x7f78681e0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 -- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540039e0 msgr2=0x7f78681461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540039e0 0x7f78681461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 -- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7868144250 msgr2=0x7f78681e0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7868144250 0x7f78681e0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 -- 172.21.15.89:0/2283939669 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680b41f0 con 0x7f78681446b0 2023-08-25T09:42:46.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786d8f2640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 0x7f78681e13f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f78680b6730 tx=0x7f7860011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:46.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860004030 con 0x7f78681446b0 2023-08-25T09:42:46.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860004190 con 0x7f78681446b0 2023-08-25T09:42:46.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7868143d30 con 0x7f78681446b0 2023-08-25T09:42:46.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786000f710 con 0x7f78681446b0 2023-08-25T09:42:46.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.404+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78681456a0 con 0x7f78681446b0 2023-08-25T09:42:46.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.405+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7868143f70 con 0x7f78681446b0 2023-08-25T09:42:46.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.406+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f786000fa80 con 0x7f78681446b0 2023-08-25T09:42:46.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.406+0000 7f785dffb640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f784c06a080 0x7f784c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.406+0000 7f786d0f1640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f784c06a080 0x7f784c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.406+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78600888e0 con 0x7f78681446b0 2023-08-25T09:42:46.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.406+0000 7f786d0f1640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f784c06a080 0x7f784c06c540 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7864034000 tx=0x7f7864007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:46.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.410+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7868143f70 con 0x7f78681446b0 2023-08-25T09:42:46.612 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.611+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7868143f70 con 0x7f78681446b0 2023-08-25T09:42:46.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.611+0000 7f785dffb640 1 -- 172.21.15.89:0/2283939669 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4082 (secure 0 0 0) 0x7f7868143f70 con 0x7f78681446b0 2023-08-25T09:42:46.613 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:46.614 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/271285710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":271285710},{"type":"v1","addr":"172.21.15.121:6833","nonce":271285710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2463890868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2463890868},{"type":"v1","addr":"172.21.15.89:6835","nonce":2463890868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:43.602424+0000","modified":"2023-08-25T09:42:46.272118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6837/3523672662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3523672662},{"type":"v1","addr":"172.21.15.89:6837","nonce":3523672662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T09:42:46.615 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 12 2023-08-25T09:42:46.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f784c06a080 msgr2=0x7f784c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f784c06a080 0x7f784c06c540 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7864034000 tx=0x7f7864007000 comp rx=0 tx=0).stop 2023-08-25T09:42:46.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 msgr2=0x7f78681e13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 0x7f78681e13f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f78680b6730 tx=0x7f7860011cf0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 shutdown_connections 2023-08-25T09:42:46.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f784c06a080 0x7f784c06c540 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78681446b0 0x7f78681e13f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7868144250 0x7f78681e0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 --2- 172.21.15.89:0/2283939669 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78540039e0 0x7f78681461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 >> 172.21.15.89:0/2283939669 conn(0x7f78680654f0 msgr2=0x7f7868148ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:46.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 shutdown_connections 2023-08-25T09:42:46.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.613+0000 7f786f355640 1 -- 172.21.15.89:0/2283939669 wait complete. 2023-08-25T09:42:46.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T09:42:46.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 Processor -- start 2023-08-25T09:42:46.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 -- start start 2023-08-25T09:42:46.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0b800b6ec0 0x7f0b800bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0b8014ddb0 0x7f0b8014e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b80145020 con 0x7f0b80144c40 2023-08-25T09:42:46.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b800b9330 con 0x7f0b800b6ec0 2023-08-25T09:42:46.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b863e8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b800b7d70 con 0x7f0b8014ddb0 2023-08-25T09:42:46.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b7f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0b800b6ec0 0x7f0b800bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b7ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0b80144c40 0x7f0b800b7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40732/0 (socket says 172.21.15.89:40732) 2023-08-25T09:42:46.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b7ffff640 1 -- 172.21.15.89:0/1869164496 learned_addr learned my addr 172.21.15.89:0/1869164496 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:46.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.725+0000 7f0b7f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0b800b6ec0 0x7f0b800bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35142/0 (socket says 172.21.15.89:35142) 2023-08-25T09:42:46.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1869164496 >> v2:172.21.15.121:3300/0 conn(0x7f0b8014ddb0 msgr2=0x7f0b8014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7f7fe640 1 --2- 172.21.15.89:0/1869164496 >> v2:172.21.15.121:3300/0 conn(0x7f0b8014ddb0 0x7f0b8014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1869164496 >> v1:172.21.15.89:6789/0 conn(0x7f0b80144c40 legacy=0x7f0b800b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1869164496 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b800bd290 con 0x7f0b800b6ec0 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7effd640 1 -- 172.21.15.89:0/1869164496 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018287609 0 0) 0x7f0b80145020 con 0x7f0b80144c40 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7f7fe640 1 --2- 172.21.15.89:0/1869164496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b800b6ec0 0x7f0b800bcc70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b800bd730 tx=0x7f0b7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15be2e669ab8b87 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.726+0000 7f0b7effd640 1 -- 172.21.15.89:0/1869164496 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70031830 con 0x7f0b800b6ec0 2023-08-25T09:42:46.731 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b7effd640 1 -- 172.21.15.89:0/1869164496 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70031990 con 0x7f0b800b6ec0 2023-08-25T09:42:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b7effd640 1 -- 172.21.15.89:0/1869164496 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70031d20 con 0x7f0b800b6ec0 2023-08-25T09:42:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 -- 172.21.15.89:0/1869164496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b800b6ec0 msgr2=0x7f0b800bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1869164496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b800b6ec0 0x7f0b800bcc70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0b800bd730 tx=0x7f0b7002b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 -- 172.21.15.89:0/1869164496 shutdown_connections 2023-08-25T09:42:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1869164496 >> v2:172.21.15.121:3300/0 conn(0x7f0b8014ddb0 0x7f0b8014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1869164496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b800b6ec0 0x7f0b800bcc70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 -- 172.21.15.89:0/1869164496 >> 172.21.15.89:0/1869164496 conn(0x7f0b800654f0 msgr2=0x7f0b800658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:46.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 -- 172.21.15.89:0/1869164496 shutdown_connections 2023-08-25T09:42:46.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.727+0000 7f0b863e8640 1 -- 172.21.15.89:0/1869164496 wait complete. 2023-08-25T09:42:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.728+0000 7f0b863e8640 1 Processor -- start 2023-08-25T09:42:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.728+0000 7f0b863e8640 1 -- start start 2023-08-25T09:42:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b863e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b800b6ec0 0x7f0b801dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b863e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 0x7f0b800b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b863e8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b8014ddb0 0x7f0b800bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b863e8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800b1510 con 0x7f0b80144c40 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b863e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800c10c0 con 0x7f0b800b6ec0 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b863e8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800befb0 con 0x7f0b8014ddb0 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 0x7f0b800b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 0x7f0b800b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35146/0 (socket says 172.21.15.89:35146) 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1984142508 learned_addr learned my addr 172.21.15.89:0/1984142508 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7ffff640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b800b6ec0 0x7f0b801dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b84985640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b8014ddb0 0x7f0b800bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b8014ddb0 msgr2=0x7f0b800bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b8014ddb0 0x7f0b800bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b800b6ec0 msgr2=0x7f0b801dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b800b6ec0 0x7f0b801dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.729+0000 7f0b7f7fe640 1 -- 172.21.15.89:0/1984142508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70009400 con 0x7f0b80144c40 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.730+0000 7f0b7f7fe640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 0x7f0b800b0fd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0b7002bee0 tx=0x7f0b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.730+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7003ba70 con 0x7f0b80144c40 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.730+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7003bbd0 con 0x7f0b80144c40 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.730+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b800be2b0 con 0x7f0b80144c40 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.730+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b700433f0 con 0x7f0b80144c40 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.730+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b800c0de0 con 0x7f0b80144c40 2023-08-25T09:42:46.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.731+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b800be110 con 0x7f0b80144c40 2023-08-25T09:42:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.731+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b7004c3b0 con 0x7f0b80144c40 2023-08-25T09:42:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.731+0000 7f0b7cff9640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0b6c06a080 0x7f0b6c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.731+0000 7f0b7ffff640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0b6c06a080 0x7f0b6c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.732+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b700aa570 con 0x7f0b80144c40 2023-08-25T09:42:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.732+0000 7f0b7ffff640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0b6c06a080 0x7f0b6c06c540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b74000f60 tx=0x7f0b74007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:46.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.736+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b800be110 con 0x7f0b80144c40 2023-08-25T09:42:46.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.903+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b800be110 con 0x7f0b80144c40 2023-08-25T09:42:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.904+0000 7f0b7cff9640 1 -- 172.21.15.89:0/1984142508 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f0b800be110 con 0x7f0b80144c40 2023-08-25T09:42:46.907 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:46.908 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":34,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T09:42:45.265370+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:42:41.332292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T09:42:42.577019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.906+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0b6c06a080 msgr2=0x7f0b6c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.906+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0b6c06a080 0x7f0b6c06c540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b74000f60 tx=0x7f0b74007d50 comp rx=0 tx=0).stop 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.906+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 msgr2=0x7f0b800b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.906+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 0x7f0b800b0fd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0b7002bee0 tx=0x7f0b700046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 shutdown_connections 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0b6c06a080 0x7f0b6c06c540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b80144c40 0x7f0b800b0fd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b8014ddb0 0x7f0b800bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 --2- 172.21.15.89:0/1984142508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b800b6ec0 0x7f0b801dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 >> 172.21.15.89:0/1984142508 conn(0x7f0b800654f0 msgr2=0x7f0b8014e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 shutdown_connections 2023-08-25T09:42:46.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:46.907+0000 7f0b863e8640 1 -- 172.21.15.89:0/1984142508 wait complete. 2023-08-25T09:42:46.915 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-08-25T09:42:46.913+0000 7f1efd1d8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T09:42:46.919 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T09:42:46.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:47.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.017+0000 7fa7aac71640 1 Processor -- start 2023-08-25T09:42:47.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.017+0000 7fa7aac71640 1 -- start start 2023-08-25T09:42:47.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7aac71640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa7a41494a0 0x7fa7a406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7aac71640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a40b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7aac71640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a4149010 con 0x7fa7a406eba0 2023-08-25T09:42:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7aac71640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40b52e0 con 0x7fa7a41494a0 2023-08-25T09:42:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7aac71640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a406e550 con 0x7fa7a40b4a90 2023-08-25T09:42:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7a920e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a40b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7a3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa7a41494a0 0x7fa7a406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7a920e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a40b9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43652/0 (socket says 172.21.15.89:43652) 2023-08-25T09:42:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7a920e640 1 -- 172.21.15.89:0/1364886142 learned_addr learned my addr 172.21.15.89:0/1364886142 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.018+0000 7fa7a8a0d640 1 --1- 172.21.15.89:0/1364886142 >> v1:172.21.15.121:6789/0 conn(0x7fa7a406eba0 0x7fa7a406d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:39782/0 (socket says 172.21.15.89:39782) 2023-08-25T09:42:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.019+0000 7fa7a920e640 1 -- 172.21.15.89:0/1364886142 >> v2:172.21.15.121:3300/0 conn(0x7fa7a41494a0 msgr2=0x7fa7a406ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.019+0000 7fa7a920e640 1 --2- 172.21.15.89:0/1364886142 >> v2:172.21.15.121:3300/0 conn(0x7fa7a41494a0 0x7fa7a406ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.019+0000 7fa7a920e640 1 -- 172.21.15.89:0/1364886142 >> v1:172.21.15.121:6789/0 conn(0x7fa7a406eba0 legacy=0x7fa7a406d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.019+0000 7fa7a920e640 1 -- 172.21.15.89:0/1364886142 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a41489c0 con 0x7fa7a40b4a90 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.019+0000 7fa7a920e640 1 --2- 172.21.15.89:0/1364886142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a40b9a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009e50 tx=0x7fa79c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cf6532f6bc5b997 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7a37fe640 1 -- 172.21.15.89:0/1364886142 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c02ca70 con 0x7fa7a40b4a90 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7a37fe640 1 -- 172.21.15.89:0/1364886142 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c02cbd0 con 0x7fa7a40b4a90 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7a37fe640 1 -- 172.21.15.89:0/1364886142 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0343f0 con 0x7fa7a40b4a90 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 -- 172.21.15.89:0/1364886142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 msgr2=0x7fa7a40b9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 --2- 172.21.15.89:0/1364886142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a40b9a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009e50 tx=0x7fa79c02bed0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 -- 172.21.15.89:0/1364886142 shutdown_connections 2023-08-25T09:42:47.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 --2- 172.21.15.89:0/1364886142 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a40b9a60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 --2- 172.21.15.89:0/1364886142 >> v2:172.21.15.121:3300/0 conn(0x7fa7a41494a0 0x7fa7a406ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 -- 172.21.15.89:0/1364886142 >> 172.21.15.89:0/1364886142 conn(0x7fa7a40be090 msgr2=0x7fa7a40be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:47.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 -- 172.21.15.89:0/1364886142 shutdown_connections 2023-08-25T09:42:47.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.020+0000 7fa7aac71640 1 -- 172.21.15.89:0/1364886142 wait complete. 2023-08-25T09:42:47.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.021+0000 7fa7aac71640 1 Processor -- start 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.021+0000 7fa7aac71640 1 -- start start 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7aac71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7a406eba0 0x7fa7a4143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7aac71640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a413d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7aac71640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 0x7fa7a413d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7aac71640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a41460a0 con 0x7fa7a41494a0 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7aac71640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4144120 con 0x7fa7a406eba0 2023-08-25T09:42:47.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7aac71640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a41459e0 con 0x7fa7a40b4a90 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 0x7fa7a413d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 0x7fa7a413d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35150/0 (socket says 172.21.15.89:35150) 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 -- 172.21.15.89:0/3236196368 learned_addr learned my addr 172.21.15.89:0/3236196368 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a3fff640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a413d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a8a0d640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7a406eba0 0x7fa7a4143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 -- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 msgr2=0x7fa7a413d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a413d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 -- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7a406eba0 msgr2=0x7fa7a4143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7a406eba0 0x7fa7a4143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 -- 172.21.15.89:0/3236196368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009b30 con 0x7fa7a41494a0 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a3fff640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a413d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a8a0d640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7a406eba0 0x7fa7a4143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.022+0000 7fa7a920e640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 0x7fa7a413d860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa79c036040 tx=0x7fa79c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.023+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c009510 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.023+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4145cc0 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.023+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c03e450 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.023+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c03e800 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.023+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4145690 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.024+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a4145820 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.024+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa79c03e960 con 0x7fa7a41494a0 2023-08-25T09:42:47.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.024+0000 7fa7a17fa640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa79006a050 0x7fa79006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.025+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa79c0ab460 con 0x7fa7a41494a0 2023-08-25T09:42:47.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.025+0000 7fa7a8a0d640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa79006a050 0x7fa79006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.025+0000 7fa7a8a0d640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa79006a050 0x7fa79006c510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa794000fb0 tx=0x7fa794007cf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.028+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa79c0769a0 con 0x7fa7a41494a0 2023-08-25T09:42:47.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.193+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7a4148ca0 con 0x7fa79006a050 2023-08-25T09:42:47.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.200+0000 7fa7a17fa640 1 -- 172.21.15.89:0/3236196368 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281444 (secure 0 0 0) 0x7fa7940074e0 con 0x7fa79006a050 2023-08-25T09:42:47.204 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:47.205 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:47.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa79006a050 msgr2=0x7fa79006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.207 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa79006a050 0x7fa79006c510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa794000fb0 tx=0x7fa794007cf0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 msgr2=0x7fa7a413d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 0x7fa7a413d860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa79c036040 tx=0x7fa79c004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:47.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 shutdown_connections 2023-08-25T09:42:47.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fa79006a050 0x7fa79006c510 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7a41494a0 0x7fa7a413d860 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7a40b4a90 0x7fa7a413d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 --2- 172.21.15.89:0/3236196368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7a406eba0 0x7fa7a4143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 >> 172.21.15.89:0/3236196368 conn(0x7fa7a40be090 msgr2=0x7fa7a40bced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:47.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 shutdown_connections 2023-08-25T09:42:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.203+0000 7fa7aac71640 1 -- 172.21.15.89:0/3236196368 wait complete. 2023-08-25T09:42:47.215 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-08-25T09:42:46.509077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2285552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.259671"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261734+0000","last_change":"2023-08-25T09:42:43.261734+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261734+0000","last_undegraded":"2023-08-25T09:42:43.261734+0000","last_fullsized":"2023-08-25T09:42:43.261734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263965+0000","last_change":"2023-08-25T09:42:43.263965+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263965+0000","last_undegraded":"2023-08-25T09:42:43.263965+0000","last_fullsized":"2023-08-25T09:42:43.263965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260230+0000","last_change":"2023-08-25T09:42:43.260230+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260230+0000","last_undegraded":"2023-08-25T09:42:43.260230+0000","last_fullsized":"2023-08-25T09:42:43.260230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263677+0000","last_change":"2023-08-25T09:42:43.263677+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263677+0000","last_undegraded":"2023-08-25T09:42:43.263677+0000","last_fullsized":"2023-08-25T09:42:43.263677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262321+0000","last_change":"2023-08-25T09:42:43.262321+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262321+0000","last_undegraded":"2023-08-25T09:42:43.262321+0000","last_fullsized":"2023-08-25T09:42:43.262321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261944+0000","last_change":"2023-08-25T09:42:43.261944+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261944+0000","last_undegraded":"2023-08-25T09:42:43.261944+0000","last_fullsized":"2023-08-25T09:42:43.261944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264994+0000","last_change":"2023-08-25T09:42:43.264994+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264994+0000","last_undegraded":"2023-08-25T09:42:43.264994+0000","last_fullsized":"2023-08-25T09:42:43.264994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262073+0000","last_change":"2023-08-25T09:42:43.262073+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262073+0000","last_undegraded":"2023-08-25T09:42:43.262073+0000","last_fullsized":"2023-08-25T09:42:43.262073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259390+0000","last_change":"2023-08-25T09:42:43.259390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259390+0000","last_undegraded":"2023-08-25T09:42:43.259390+0000","last_fullsized":"2023-08-25T09:42:43.259390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263942+0000","last_change":"2023-08-25T09:42:43.263942+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263942+0000","last_undegraded":"2023-08-25T09:42:43.263942+0000","last_fullsized":"2023-08-25T09:42:43.263942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263245+0000","last_change":"2023-08-25T09:42:43.263245+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263245+0000","last_undegraded":"2023-08-25T09:42:43.263245+0000","last_fullsized":"2023-08-25T09:42:43.263245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260368+0000","last_change":"2023-08-25T09:42:43.260368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260368+0000","last_undegraded":"2023-08-25T09:42:43.260368+0000","last_fullsized":"2023-08-25T09:42:43.260368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262375+0000","last_change":"2023-08-25T09:42:43.262375+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262375+0000","last_undegraded":"2023-08-25T09:42:43.262375+0000","last_fullsized":"2023-08-25T09:42:43.262375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260475+0000","last_change":"2023-08-25T09:42:43.260475+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260475+0000","last_undegraded":"2023-08-25T09:42:43.260475+0000","last_fullsized":"2023-08-25T09:42:43.260475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264083+0000","last_change":"2023-08-25T09:42:43.264083+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264083+0000","last_undegraded":"2023-08-25T09:42:43.264083+0000","last_fullsized":"2023-08-25T09:42:43.264083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264112+0000","last_change":"2023-08-25T09:42:43.264112+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264112+0000","last_undegraded":"2023-08-25T09:42:43.264112+0000","last_fullsized":"2023-08-25T09:42:43.264112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263584+0000","last_change":"2023-08-25T09:42:43.263584+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263584+0000","last_undegraded":"2023-08-25T09:42:43.263584+0000","last_fullsized":"2023-08-25T09:42:43.263584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262805+0000","last_change":"2023-08-25T09:42:43.262805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262805+0000","last_undegraded":"2023-08-25T09:42:43.262805+0000","last_fullsized":"2023-08-25T09:42:43.262805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261226+0000","last_change":"2023-08-25T09:42:43.261226+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261226+0000","last_undegraded":"2023-08-25T09:42:43.261226+0000","last_fullsized":"2023-08-25T09:42:43.261226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265721+0000","last_change":"2023-08-25T09:42:43.265721+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265721+0000","last_undegraded":"2023-08-25T09:42:43.265721+0000","last_fullsized":"2023-08-25T09:42:43.265721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263420+0000","last_change":"2023-08-25T09:42:43.263420+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263420+0000","last_undegraded":"2023-08-25T09:42:43.263420+0000","last_fullsized":"2023-08-25T09:42:43.263420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258833+0000","last_change":"2023-08-25T09:42:43.258833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258833+0000","last_undegraded":"2023-08-25T09:42:43.258833+0000","last_fullsized":"2023-08-25T09:42:43.258833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265206+0000","last_change":"2023-08-25T09:42:43.265206+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265206+0000","last_undegraded":"2023-08-25T09:42:43.265206+0000","last_fullsized":"2023-08-25T09:42:43.265206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262857+0000","last_change":"2023-08-25T09:42:43.262857+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262857+0000","last_undegraded":"2023-08-25T09:42:43.262857+0000","last_fullsized":"2023-08-25T09:42:43.262857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263805+0000","last_change":"2023-08-25T09:42:43.263805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263805+0000","last_undegraded":"2023-08-25T09:42:43.263805+0000","last_fullsized":"2023-08-25T09:42:43.263805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262743+0000","last_change":"2023-08-25T09:42:43.262743+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262743+0000","last_undegraded":"2023-08-25T09:42:43.262743+0000","last_fullsized":"2023-08-25T09:42:43.262743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264893+0000","last_change":"2023-08-25T09:42:43.264893+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264893+0000","last_undegraded":"2023-08-25T09:42:43.264893+0000","last_fullsized":"2023-08-25T09:42:43.264893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263506+0000","last_change":"2023-08-25T09:42:43.263506+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263506+0000","last_undegraded":"2023-08-25T09:42:43.263506+0000","last_fullsized":"2023-08-25T09:42:43.263506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.266155+0000","last_change":"2023-08-25T09:42:43.266155+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.266155+0000","last_undegraded":"2023-08-25T09:42:43.266155+0000","last_fullsized":"2023-08-25T09:42:43.266155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262663+0000","last_change":"2023-08-25T09:42:43.262663+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262663+0000","last_undegraded":"2023-08-25T09:42:43.262663+0000","last_fullsized":"2023-08-25T09:42:43.262663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263511+0000","last_change":"2023-08-25T09:42:43.263511+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263511+0000","last_undegraded":"2023-08-25T09:42:43.263511+0000","last_fullsized":"2023-08-25T09:42:43.263511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261258+0000","last_change":"2023-08-25T09:42:43.261258+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261258+0000","last_undegraded":"2023-08-25T09:42:43.261258+0000","last_fullsized":"2023-08-25T09:42:43.261258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265686+0000","last_change":"2023-08-25T09:42:43.265686+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265686+0000","last_undegraded":"2023-08-25T09:42:43.265686+0000","last_fullsized":"2023-08-25T09:42:43.265686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275831+0000","last_change":"2023-08-25T09:42:43.274652+0000","last_active":"2023-08-25T09:42:43.275831+0000","last_peered":"2023-08-25T09:42:43.275831+0000","last_clean":"2023-08-25T09:42:43.275831+0000","last_became_active":"2023-08-25T09:42:43.274360+0000","last_became_peered":"2023-08-25T09:42:43.274360+0000","last_unstale":"2023-08-25T09:42:43.275831+0000","last_undegraded":"2023-08-25T09:42:43.275831+0000","last_fullsized":"2023-08-25T09:42:43.275831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:10.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260708+0000","last_change":"2023-08-25T09:42:43.260708+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260708+0000","last_undegraded":"2023-08-25T09:42:43.260708+0000","last_fullsized":"2023-08-25T09:42:43.260708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274478+0000","last_change":"2023-08-25T09:42:43.269611+0000","last_active":"2023-08-25T09:42:43.274478+0000","last_peered":"2023-08-25T09:42:43.274478+0000","last_clean":"2023-08-25T09:42:43.274478+0000","last_became_active":"2023-08-25T09:42:43.269334+0000","last_became_peered":"2023-08-25T09:42:43.269334+0000","last_unstale":"2023-08-25T09:42:43.274478+0000","last_undegraded":"2023-08-25T09:42:43.274478+0000","last_fullsized":"2023-08-25T09:42:43.274478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:57:42.803780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259397+0000","last_change":"2023-08-25T09:42:43.259397+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259397+0000","last_undegraded":"2023-08-25T09:42:43.259397+0000","last_fullsized":"2023-08-25T09:42:43.259397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274336+0000","last_change":"2023-08-25T09:42:43.270208+0000","last_active":"2023-08-25T09:42:43.274336+0000","last_peered":"2023-08-25T09:42:43.274336+0000","last_clean":"2023-08-25T09:42:43.274336+0000","last_became_active":"2023-08-25T09:42:43.269906+0000","last_became_peered":"2023-08-25T09:42:43.269906+0000","last_unstale":"2023-08-25T09:42:43.274336+0000","last_undegraded":"2023-08-25T09:42:43.274336+0000","last_fullsized":"2023-08-25T09:42:43.274336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:33.970812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261188+0000","last_change":"2023-08-25T09:42:43.261188+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261188+0000","last_undegraded":"2023-08-25T09:42:43.261188+0000","last_fullsized":"2023-08-25T09:42:43.261188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273929+0000","last_change":"2023-08-25T09:42:43.269894+0000","last_active":"2023-08-25T09:42:43.273929+0000","last_peered":"2023-08-25T09:42:43.273929+0000","last_clean":"2023-08-25T09:42:43.273929+0000","last_became_active":"2023-08-25T09:42:43.269588+0000","last_became_peered":"2023-08-25T09:42:43.269588+0000","last_unstale":"2023-08-25T09:42:43.273929+0000","last_undegraded":"2023-08-25T09:42:43.273929+0000","last_fullsized":"2023-08-25T09:42:43.273929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:23.583856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261390+0000","last_change":"2023-08-25T09:42:43.261390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261390+0000","last_undegraded":"2023-08-25T09:42:43.261390+0000","last_fullsized":"2023-08-25T09:42:43.261390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276184+0000","last_change":"2023-08-25T09:42:43.274532+0000","last_active":"2023-08-25T09:42:43.276184+0000","last_peered":"2023-08-25T09:42:43.276184+0000","last_clean":"2023-08-25T09:42:43.276184+0000","last_became_active":"2023-08-25T09:42:43.274259+0000","last_became_peered":"2023-08-25T09:42:43.274259+0000","last_unstale":"2023-08-25T09:42:43.276184+0000","last_undegraded":"2023-08-25T09:42:43.276184+0000","last_fullsized":"2023-08-25T09:42:43.276184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263486+0000","last_change":"2023-08-25T09:42:43.263486+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263486+0000","last_undegraded":"2023-08-25T09:42:43.263486+0000","last_fullsized":"2023-08-25T09:42:43.263486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272496+0000","last_change":"2023-08-25T09:42:43.271395+0000","last_active":"2023-08-25T09:42:43.272496+0000","last_peered":"2023-08-25T09:42:43.272496+0000","last_clean":"2023-08-25T09:42:43.272496+0000","last_became_active":"2023-08-25T09:42:43.271122+0000","last_became_peered":"2023-08-25T09:42:43.271122+0000","last_unstale":"2023-08-25T09:42:43.272496+0000","last_undegraded":"2023-08-25T09:42:43.272496+0000","last_fullsized":"2023-08-25T09:42:43.272496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:19.767009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259595+0000","last_change":"2023-08-25T09:42:43.259595+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259595+0000","last_undegraded":"2023-08-25T09:42:43.259595+0000","last_fullsized":"2023-08-25T09:42:43.259595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277824+0000","last_change":"2023-08-25T09:42:43.275402+0000","last_active":"2023-08-25T09:42:43.277824+0000","last_peered":"2023-08-25T09:42:43.277824+0000","last_clean":"2023-08-25T09:42:43.277824+0000","last_became_active":"2023-08-25T09:42:43.275116+0000","last_became_peered":"2023-08-25T09:42:43.275116+0000","last_unstale":"2023-08-25T09:42:43.277824+0000","last_undegraded":"2023-08-25T09:42:43.277824+0000","last_fullsized":"2023-08-25T09:42:43.277824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264298+0000","last_change":"2023-08-25T09:42:43.264298+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264298+0000","last_undegraded":"2023-08-25T09:42:43.264298+0000","last_fullsized":"2023-08-25T09:42:43.264298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272105+0000","last_change":"2023-08-25T09:42:43.269075+0000","last_active":"2023-08-25T09:42:43.272105+0000","last_peered":"2023-08-25T09:42:43.272105+0000","last_clean":"2023-08-25T09:42:43.272105+0000","last_became_active":"2023-08-25T09:42:43.268787+0000","last_became_peered":"2023-08-25T09:42:43.268787+0000","last_unstale":"2023-08-25T09:42:43.272105+0000","last_undegraded":"2023-08-25T09:42:43.272105+0000","last_fullsized":"2023-08-25T09:42:43.272105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:05.324298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263139+0000","last_change":"2023-08-25T09:42:43.263139+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263139+0000","last_undegraded":"2023-08-25T09:42:43.263139+0000","last_fullsized":"2023-08-25T09:42:43.263139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269087+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269087+0000","last_peered":"2023-08-25T09:42:43.269087+0000","last_clean":"2023-08-25T09:42:43.269087+0000","last_became_active":"2023-08-25T09:42:43.265064+0000","last_became_peered":"2023-08-25T09:42:43.265064+0000","last_unstale":"2023-08-25T09:42:43.269087+0000","last_undegraded":"2023-08-25T09:42:43.269087+0000","last_fullsized":"2023-08-25T09:42:43.269087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:30:21.363562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262964+0000","last_change":"2023-08-25T09:42:43.262964+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262964+0000","last_undegraded":"2023-08-25T09:42:43.262964+0000","last_fullsized":"2023-08-25T09:42:43.262964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277387+0000","last_change":"2023-08-25T09:42:43.276586+0000","last_active":"2023-08-25T09:42:43.277387+0000","last_peered":"2023-08-25T09:42:43.277387+0000","last_clean":"2023-08-25T09:42:43.277387+0000","last_became_active":"2023-08-25T09:42:43.276311+0000","last_became_peered":"2023-08-25T09:42:43.276311+0000","last_unstale":"2023-08-25T09:42:43.277387+0000","last_undegraded":"2023-08-25T09:42:43.277387+0000","last_fullsized":"2023-08-25T09:42:43.277387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:17:09.330315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263305+0000","last_change":"2023-08-25T09:42:43.263305+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263305+0000","last_undegraded":"2023-08-25T09:42:43.263305+0000","last_fullsized":"2023-08-25T09:42:43.263305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276924+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.276924+0000","last_peered":"2023-08-25T09:42:43.276924+0000","last_clean":"2023-08-25T09:42:43.276924+0000","last_became_active":"2023-08-25T09:42:43.275295+0000","last_became_peered":"2023-08-25T09:42:43.275295+0000","last_unstale":"2023-08-25T09:42:43.276924+0000","last_undegraded":"2023-08-25T09:42:43.276924+0000","last_fullsized":"2023-08-25T09:42:43.276924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:37.726279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258959+0000","last_change":"2023-08-25T09:42:43.258959+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258959+0000","last_undegraded":"2023-08-25T09:42:43.258959+0000","last_fullsized":"2023-08-25T09:42:43.258959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271742+0000","last_change":"2023-08-25T09:42:43.268508+0000","last_active":"2023-08-25T09:42:43.271742+0000","last_peered":"2023-08-25T09:42:43.271742+0000","last_clean":"2023-08-25T09:42:43.271742+0000","last_became_active":"2023-08-25T09:42:43.268143+0000","last_became_peered":"2023-08-25T09:42:43.268143+0000","last_unstale":"2023-08-25T09:42:43.271742+0000","last_undegraded":"2023-08-25T09:42:43.271742+0000","last_fullsized":"2023-08-25T09:42:43.271742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:38:14.600448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259876+0000","last_change":"2023-08-25T09:42:43.259876+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259876+0000","last_undegraded":"2023-08-25T09:42:43.259876+0000","last_fullsized":"2023-08-25T09:42:43.259876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271668+0000","last_change":"2023-08-25T09:42:43.267210+0000","last_active":"2023-08-25T09:42:43.271668+0000","last_peered":"2023-08-25T09:42:43.271668+0000","last_clean":"2023-08-25T09:42:43.271668+0000","last_became_active":"2023-08-25T09:42:43.266940+0000","last_became_peered":"2023-08-25T09:42:43.266940+0000","last_unstale":"2023-08-25T09:42:43.271668+0000","last_undegraded":"2023-08-25T09:42:43.271668+0000","last_fullsized":"2023-08-25T09:42:43.271668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261573+0000","last_change":"2023-08-25T09:42:43.261573+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261573+0000","last_undegraded":"2023-08-25T09:42:43.261573+0000","last_fullsized":"2023-08-25T09:42:43.261573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278080+0000","last_change":"2023-08-25T09:42:43.276967+0000","last_active":"2023-08-25T09:42:43.278080+0000","last_peered":"2023-08-25T09:42:43.278080+0000","last_clean":"2023-08-25T09:42:43.278080+0000","last_became_active":"2023-08-25T09:42:43.276646+0000","last_became_peered":"2023-08-25T09:42:43.276646+0000","last_unstale":"2023-08-25T09:42:43.278080+0000","last_undegraded":"2023-08-25T09:42:43.278080+0000","last_fullsized":"2023-08-25T09:42:43.278080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262991+0000","last_change":"2023-08-25T09:42:43.262991+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262991+0000","last_undegraded":"2023-08-25T09:42:43.262991+0000","last_fullsized":"2023-08-25T09:42:43.262991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275811+0000","last_change":"2023-08-25T09:42:43.274167+0000","last_active":"2023-08-25T09:42:43.275811+0000","last_peered":"2023-08-25T09:42:43.275811+0000","last_clean":"2023-08-25T09:42:43.275811+0000","last_became_active":"2023-08-25T09:42:43.273457+0000","last_became_peered":"2023-08-25T09:42:43.273457+0000","last_unstale":"2023-08-25T09:42:43.275811+0000","last_undegraded":"2023-08-25T09:42:43.275811+0000","last_fullsized":"2023-08-25T09:42:43.275811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:49.533731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263833+0000","last_change":"2023-08-25T09:42:43.263833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263833+0000","last_undegraded":"2023-08-25T09:42:43.263833+0000","last_fullsized":"2023-08-25T09:42:43.263833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276310+0000","last_change":"2023-08-25T09:42:43.273820+0000","last_active":"2023-08-25T09:42:43.276310+0000","last_peered":"2023-08-25T09:42:43.276310+0000","last_clean":"2023-08-25T09:42:43.276310+0000","last_became_active":"2023-08-25T09:42:43.273362+0000","last_became_peered":"2023-08-25T09:42:43.273362+0000","last_unstale":"2023-08-25T09:42:43.276310+0000","last_undegraded":"2023-08-25T09:42:43.276310+0000","last_fullsized":"2023-08-25T09:42:43.276310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:30:11.556739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264574+0000","last_change":"2023-08-25T09:42:43.264574+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264574+0000","last_undegraded":"2023-08-25T09:42:43.264574+0000","last_fullsized":"2023-08-25T09:42:43.264574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277358+0000","last_change":"2023-08-25T09:42:43.276386+0000","last_active":"2023-08-25T09:42:43.277358+0000","last_peered":"2023-08-25T09:42:43.277358+0000","last_clean":"2023-08-25T09:42:43.277358+0000","last_became_active":"2023-08-25T09:42:43.276029+0000","last_became_peered":"2023-08-25T09:42:43.276029+0000","last_unstale":"2023-08-25T09:42:43.277358+0000","last_undegraded":"2023-08-25T09:42:43.277358+0000","last_fullsized":"2023-08-25T09:42:43.277358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:10.071794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262312+0000","last_change":"2023-08-25T09:42:43.262312+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262312+0000","last_undegraded":"2023-08-25T09:42:43.262312+0000","last_fullsized":"2023-08-25T09:42:43.262312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275617+0000","last_change":"2023-08-25T09:42:43.273234+0000","last_active":"2023-08-25T09:42:43.275617+0000","last_peered":"2023-08-25T09:42:43.275617+0000","last_clean":"2023-08-25T09:42:43.275617+0000","last_became_active":"2023-08-25T09:42:43.272846+0000","last_became_peered":"2023-08-25T09:42:43.272846+0000","last_unstale":"2023-08-25T09:42:43.275617+0000","last_undegraded":"2023-08-25T09:42:43.275617+0000","last_fullsized":"2023-08-25T09:42:43.275617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:22:28.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259960+0000","last_change":"2023-08-25T09:42:43.259960+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259960+0000","last_undegraded":"2023-08-25T09:42:43.259960+0000","last_fullsized":"2023-08-25T09:42:43.259960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274963+0000","last_change":"2023-08-25T09:42:43.271438+0000","last_active":"2023-08-25T09:42:43.274963+0000","last_peered":"2023-08-25T09:42:43.274963+0000","last_clean":"2023-08-25T09:42:43.274963+0000","last_became_active":"2023-08-25T09:42:43.271184+0000","last_became_peered":"2023-08-25T09:42:43.271184+0000","last_unstale":"2023-08-25T09:42:43.274963+0000","last_undegraded":"2023-08-25T09:42:43.274963+0000","last_fullsized":"2023-08-25T09:42:43.274963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:48.671798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260382+0000","last_change":"2023-08-25T09:42:43.260382+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260382+0000","last_undegraded":"2023-08-25T09:42:43.260382+0000","last_fullsized":"2023-08-25T09:42:43.260382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274356+0000","last_change":"2023-08-25T09:42:43.270977+0000","last_active":"2023-08-25T09:42:43.274356+0000","last_peered":"2023-08-25T09:42:43.274356+0000","last_clean":"2023-08-25T09:42:43.274356+0000","last_became_active":"2023-08-25T09:42:43.270702+0000","last_became_peered":"2023-08-25T09:42:43.270702+0000","last_unstale":"2023-08-25T09:42:43.274356+0000","last_undegraded":"2023-08-25T09:42:43.274356+0000","last_fullsized":"2023-08-25T09:42:43.274356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:21.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262444+0000","last_change":"2023-08-25T09:42:43.262444+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262444+0000","last_undegraded":"2023-08-25T09:42:43.262444+0000","last_fullsized":"2023-08-25T09:42:43.262444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274363+0000","last_change":"2023-08-25T09:42:43.268849+0000","last_active":"2023-08-25T09:42:43.274363+0000","last_peered":"2023-08-25T09:42:43.274363+0000","last_clean":"2023-08-25T09:42:43.274363+0000","last_became_active":"2023-08-25T09:42:43.268561+0000","last_became_peered":"2023-08-25T09:42:43.268561+0000","last_unstale":"2023-08-25T09:42:43.274363+0000","last_undegraded":"2023-08-25T09:42:43.274363+0000","last_fullsized":"2023-08-25T09:42:43.274363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:35:49.609217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259747+0000","last_change":"2023-08-25T09:42:43.259747+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259747+0000","last_undegraded":"2023-08-25T09:42:43.259747+0000","last_fullsized":"2023-08-25T09:42:43.259747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274213+0000","last_change":"2023-08-25T09:42:43.267133+0000","last_active":"2023-08-25T09:42:43.274213+0000","last_peered":"2023-08-25T09:42:43.274213+0000","last_clean":"2023-08-25T09:42:43.274213+0000","last_became_active":"2023-08-25T09:42:43.266868+0000","last_became_peered":"2023-08-25T09:42:43.266868+0000","last_unstale":"2023-08-25T09:42:43.274213+0000","last_undegraded":"2023-08-25T09:42:43.274213+0000","last_fullsized":"2023-08-25T09:42:43.274213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:04.490031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261974+0000","last_change":"2023-08-25T09:42:43.261974+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261974+0000","last_undegraded":"2023-08-25T09:42:43.261974+0000","last_fullsized":"2023-08-25T09:42:43.261974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272464+0000","last_change":"2023-08-25T09:42:43.270692+0000","last_active":"2023-08-25T09:42:43.272464+0000","last_peered":"2023-08-25T09:42:43.272464+0000","last_clean":"2023-08-25T09:42:43.272464+0000","last_became_active":"2023-08-25T09:42:43.270431+0000","last_became_peered":"2023-08-25T09:42:43.270431+0000","last_unstale":"2023-08-25T09:42:43.272464+0000","last_undegraded":"2023-08-25T09:42:43.272464+0000","last_fullsized":"2023-08-25T09:42:43.272464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259665+0000","last_change":"2023-08-25T09:42:43.259665+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259665+0000","last_undegraded":"2023-08-25T09:42:43.259665+0000","last_fullsized":"2023-08-25T09:42:43.259665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274915+0000","last_change":"2023-08-25T09:42:43.270252+0000","last_active":"2023-08-25T09:42:43.274915+0000","last_peered":"2023-08-25T09:42:43.274915+0000","last_clean":"2023-08-25T09:42:43.274915+0000","last_became_active":"2023-08-25T09:42:43.269931+0000","last_became_peered":"2023-08-25T09:42:43.269931+0000","last_unstale":"2023-08-25T09:42:43.274915+0000","last_undegraded":"2023-08-25T09:42:43.274915+0000","last_fullsized":"2023-08-25T09:42:43.274915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:39:53.965422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262501+0000","last_change":"2023-08-25T09:42:43.262501+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262501+0000","last_undegraded":"2023-08-25T09:42:43.262501+0000","last_fullsized":"2023-08-25T09:42:43.262501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276362+0000","last_change":"2023-08-25T09:42:43.275120+0000","last_active":"2023-08-25T09:42:43.276362+0000","last_peered":"2023-08-25T09:42:43.276362+0000","last_clean":"2023-08-25T09:42:43.276362+0000","last_became_active":"2023-08-25T09:42:43.274864+0000","last_became_peered":"2023-08-25T09:42:43.274864+0000","last_unstale":"2023-08-25T09:42:43.276362+0000","last_undegraded":"2023-08-25T09:42:43.276362+0000","last_fullsized":"2023-08-25T09:42:43.276362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:38.615225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266390+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:43.266390+0000","last_peered":"2023-08-25T09:42:43.266390+0000","last_clean":"2023-08-25T09:42:43.266390+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:43.266390+0000","last_undegraded":"2023-08-25T09:42:43.266390+0000","last_fullsized":"2023-08-25T09:42:43.266390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:21:35.220456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271808+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:43.271808+0000","last_peered":"2023-08-25T09:42:43.271808+0000","last_clean":"2023-08-25T09:42:43.271808+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:43.271808+0000","last_undegraded":"2023-08-25T09:42:43.271808+0000","last_fullsized":"2023-08-25T09:42:43.271808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:50:11.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261413+0000","last_change":"2023-08-25T09:42:43.261413+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261413+0000","last_undegraded":"2023-08-25T09:42:43.261413+0000","last_fullsized":"2023-08-25T09:42:43.261413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277049+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.277049+0000","last_peered":"2023-08-25T09:42:43.277049+0000","last_clean":"2023-08-25T09:42:43.277049+0000","last_became_active":"2023-08-25T09:42:43.275237+0000","last_became_peered":"2023-08-25T09:42:43.275237+0000","last_unstale":"2023-08-25T09:42:43.277049+0000","last_undegraded":"2023-08-25T09:42:43.277049+0000","last_fullsized":"2023-08-25T09:42:43.277049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:49.486016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266259+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:43.266259+0000","last_peered":"2023-08-25T09:42:43.266259+0000","last_clean":"2023-08-25T09:42:43.266259+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:43.266259+0000","last_undegraded":"2023-08-25T09:42:43.266259+0000","last_fullsized":"2023-08-25T09:42:43.266259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:04:36.548473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262490+0000","last_change":"2023-08-25T09:42:43.262490+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262490+0000","last_undegraded":"2023-08-25T09:42:43.262490+0000","last_fullsized":"2023-08-25T09:42:43.262490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278134+0000","last_change":"2023-08-25T09:42:43.276569+0000","last_active":"2023-08-25T09:42:43.278134+0000","last_peered":"2023-08-25T09:42:43.278134+0000","last_clean":"2023-08-25T09:42:43.278134+0000","last_became_active":"2023-08-25T09:42:43.276306+0000","last_became_peered":"2023-08-25T09:42:43.276306+0000","last_unstale":"2023-08-25T09:42:43.278134+0000","last_undegraded":"2023-08-25T09:42:43.278134+0000","last_fullsized":"2023-08-25T09:42:43.278134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:12:20.185119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.259490+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:43.259490+0000","last_peered":"2023-08-25T09:42:43.259490+0000","last_clean":"2023-08-25T09:42:43.259490+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:43.259490+0000","last_undegraded":"2023-08-25T09:42:43.259490+0000","last_fullsized":"2023-08-25T09:42:43.259490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:19.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262174+0000","last_change":"2023-08-25T09:42:43.262174+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262174+0000","last_undegraded":"2023-08-25T09:42:43.262174+0000","last_fullsized":"2023-08-25T09:42:43.262174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269613+0000","last_change":"2023-08-25T09:42:43.267196+0000","last_active":"2023-08-25T09:42:43.269613+0000","last_peered":"2023-08-25T09:42:43.269613+0000","last_clean":"2023-08-25T09:42:43.269613+0000","last_became_active":"2023-08-25T09:42:43.266945+0000","last_became_peered":"2023-08-25T09:42:43.266945+0000","last_unstale":"2023-08-25T09:42:43.269613+0000","last_undegraded":"2023-08-25T09:42:43.269613+0000","last_fullsized":"2023-08-25T09:42:43.269613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:13:03.220760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271657+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:43.271657+0000","last_peered":"2023-08-25T09:42:43.271657+0000","last_clean":"2023-08-25T09:42:43.271657+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:43.271657+0000","last_undegraded":"2023-08-25T09:42:43.271657+0000","last_fullsized":"2023-08-25T09:42:43.271657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:01.957756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259368+0000","last_change":"2023-08-25T09:42:43.259368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259368+0000","last_undegraded":"2023-08-25T09:42:43.259368+0000","last_fullsized":"2023-08-25T09:42:43.259368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274716+0000","last_change":"2023-08-25T09:42:43.270865+0000","last_active":"2023-08-25T09:42:43.274716+0000","last_peered":"2023-08-25T09:42:43.274716+0000","last_clean":"2023-08-25T09:42:43.274716+0000","last_became_active":"2023-08-25T09:42:43.270528+0000","last_became_peered":"2023-08-25T09:42:43.270528+0000","last_unstale":"2023-08-25T09:42:43.274716+0000","last_undegraded":"2023-08-25T09:42:43.274716+0000","last_fullsized":"2023-08-25T09:42:43.274716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:02.604480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.261656+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:43.261656+0000","last_peered":"2023-08-25T09:42:43.261656+0000","last_clean":"2023-08-25T09:42:43.261656+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:43.261656+0000","last_undegraded":"2023-08-25T09:42:43.261656+0000","last_fullsized":"2023-08-25T09:42:43.261656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:23.036411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259879+0000","last_change":"2023-08-25T09:42:43.259879+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259879+0000","last_undegraded":"2023-08-25T09:42:43.259879+0000","last_fullsized":"2023-08-25T09:42:43.259879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272362+0000","last_change":"2023-08-25T09:42:43.270587+0000","last_active":"2023-08-25T09:42:43.272362+0000","last_peered":"2023-08-25T09:42:43.272362+0000","last_clean":"2023-08-25T09:42:43.272362+0000","last_became_active":"2023-08-25T09:42:43.270215+0000","last_became_peered":"2023-08-25T09:42:43.270215+0000","last_unstale":"2023-08-25T09:42:43.272362+0000","last_undegraded":"2023-08-25T09:42:43.272362+0000","last_fullsized":"2023-08-25T09:42:43.272362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:20.358964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266898+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:43.266898+0000","last_peered":"2023-08-25T09:42:43.266898+0000","last_clean":"2023-08-25T09:42:43.266898+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:43.266898+0000","last_undegraded":"2023-08-25T09:42:43.266898+0000","last_fullsized":"2023-08-25T09:42:43.266898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.288915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260072+0000","last_change":"2023-08-25T09:42:43.260072+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260072+0000","last_undegraded":"2023-08-25T09:42:43.260072+0000","last_fullsized":"2023-08-25T09:42:43.260072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273966+0000","last_change":"2023-08-25T09:42:43.269888+0000","last_active":"2023-08-25T09:42:43.273966+0000","last_peered":"2023-08-25T09:42:43.273966+0000","last_clean":"2023-08-25T09:42:43.273966+0000","last_became_active":"2023-08-25T09:42:43.269578+0000","last_became_peered":"2023-08-25T09:42:43.269578+0000","last_unstale":"2023-08-25T09:42:43.273966+0000","last_undegraded":"2023-08-25T09:42:43.273966+0000","last_fullsized":"2023-08-25T09:42:43.273966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.262969+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:43.262969+0000","last_peered":"2023-08-25T09:42:43.262969+0000","last_clean":"2023-08-25T09:42:43.262969+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:43.262969+0000","last_undegraded":"2023-08-25T09:42:43.262969+0000","last_fullsized":"2023-08-25T09:42:43.262969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:02.450633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264885+0000","last_change":"2023-08-25T09:42:43.264885+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264885+0000","last_undegraded":"2023-08-25T09:42:43.264885+0000","last_fullsized":"2023-08-25T09:42:43.264885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269004+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269004+0000","last_peered":"2023-08-25T09:42:43.269004+0000","last_clean":"2023-08-25T09:42:43.269004+0000","last_became_active":"2023-08-25T09:42:43.265091+0000","last_became_peered":"2023-08-25T09:42:43.265091+0000","last_unstale":"2023-08-25T09:42:43.269004+0000","last_undegraded":"2023-08-25T09:42:43.269004+0000","last_fullsized":"2023-08-25T09:42:43.269004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:44:40.542410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.264119+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:43.264119+0000","last_peered":"2023-08-25T09:42:43.264119+0000","last_clean":"2023-08-25T09:42:43.264119+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:43.264119+0000","last_undegraded":"2023-08-25T09:42:43.264119+0000","last_fullsized":"2023-08-25T09:42:43.264119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:54.470307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":726813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":733441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:47.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.352+0000 7f670a614640 1 Processor -- start 2023-08-25T09:42:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.352+0000 7f670a614640 1 -- start start 2023-08-25T09:42:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f670a614640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6704070c00 0x7f6704148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f670a614640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040b30d0 con 0x7f67040b39e0 2023-08-25T09:42:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f670a614640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040b2b10 con 0x7f67040b7340 2023-08-25T09:42:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f670a614640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040b2df0 con 0x7f6704070c00 2023-08-25T09:42:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f6703fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6704070c00 0x7f6704148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f6703fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6704070c00 0x7f6704148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35162/0 (socket says 172.21.15.89:35162) 2023-08-25T09:42:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f6703fff640 1 -- 172.21.15.89:0/2996045720 learned_addr learned my addr 172.21.15.89:0/2996045720 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.353+0000 7f6708bb1640 1 --1- 172.21.15.89:0/2996045720 >> v1:172.21.15.89:6789/0 conn(0x7f67040b39e0 0x7f6704153060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40746/0 (socket says 172.21.15.89:40746) 2023-08-25T09:42:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6703fff640 1 -- 172.21.15.89:0/2996045720 >> v1:172.21.15.121:6789/0 conn(0x7f67040b7340 legacy=0x7f6704142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6703fff640 1 -- 172.21.15.89:0/2996045720 >> v1:172.21.15.89:6789/0 conn(0x7f67040b39e0 legacy=0x7f6704153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6702ffd640 1 -- 172.21.15.89:0/2996045720 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926748294 0 0) 0x7f67040b30d0 con 0x7f67040b39e0 2023-08-25T09:42:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6703fff640 1 -- 172.21.15.89:0/2996045720 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040b34c0 con 0x7f6704070c00 2023-08-25T09:42:47.359 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6703fff640 1 --2- 172.21.15.89:0/2996045720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6704070c00 0x7f6704148810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009870 tx=0x7f66f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0be4e0bb91148d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6702ffd640 1 -- 172.21.15.89:0/2996045720 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4031870 con 0x7f6704070c00 2023-08-25T09:42:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6702ffd640 1 -- 172.21.15.89:0/2996045720 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f40319d0 con 0x7f6704070c00 2023-08-25T09:42:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.354+0000 7f6702ffd640 1 -- 172.21.15.89:0/2996045720 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4031d60 con 0x7f6704070c00 2023-08-25T09:42:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 -- 172.21.15.89:0/2996045720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6704070c00 msgr2=0x7f6704148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 --2- 172.21.15.89:0/2996045720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6704070c00 0x7f6704148810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009870 tx=0x7f66f402b910 comp rx=0 tx=0).stop 2023-08-25T09:42:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 -- 172.21.15.89:0/2996045720 shutdown_connections 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 --2- 172.21.15.89:0/2996045720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6704070c00 0x7f6704148810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 -- 172.21.15.89:0/2996045720 >> 172.21.15.89:0/2996045720 conn(0x7f6704069a30 msgr2=0x7f6704069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 -- 172.21.15.89:0/2996045720 shutdown_connections 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.355+0000 7f670a614640 1 -- 172.21.15.89:0/2996045720 wait complete. 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.356+0000 7f670a614640 1 Processor -- start 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.356+0000 7f670a614640 1 -- start start 2023-08-25T09:42:47.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704070c00 0x7f6704141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 0x7f670413a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67040b7340 0x7f670413a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6704141740 con 0x7f67040b39e0 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67041e0c90 con 0x7f6704070c00 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67041457f0 con 0x7f67040b7340 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 0x7f670413a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 0x7f670413a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35168/0 (socket says 172.21.15.89:35168) 2023-08-25T09:42:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 -- 172.21.15.89:0/33494488 learned_addr learned my addr 172.21.15.89:0/33494488 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f6703fff640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704070c00 0x7f6704141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f6708bb1640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67040b7340 0x7f670413a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 -- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67040b7340 msgr2=0x7f670413a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67040b7340 0x7f670413a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 -- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704070c00 msgr2=0x7f6704141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704070c00 0x7f6704141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 -- 172.21.15.89:0/33494488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40094d0 con 0x7f67040b39e0 2023-08-25T09:42:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f67037fe640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 0x7f670413a3a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66f800b3f0 tx=0x7f66f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8011830 con 0x7f67040b39e0 2023-08-25T09:42:47.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8011990 con 0x7f67040b39e0 2023-08-25T09:42:47.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8011d40 con 0x7f67040b39e0 2023-08-25T09:42:47.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.357+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6704148490 con 0x7f67040b39e0 2023-08-25T09:42:47.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.358+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040b21a0 con 0x7f67040b39e0 2023-08-25T09:42:47.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.358+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67041e0e40 con 0x7f67040b39e0 2023-08-25T09:42:47.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.359+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f66f801a400 con 0x7f67040b39e0 2023-08-25T09:42:47.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.359+0000 7f6700ff9640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f66f006a080 0x7f66f006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.365 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.359+0000 7f6703fff640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f66f006a080 0x7f66f006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.359+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f66f80881b0 con 0x7f67040b39e0 2023-08-25T09:42:47.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.360+0000 7f6703fff640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f66f006a080 0x7f66f006c540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66f4036000 tx=0x7f66f403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.363+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f67041e0e40 con 0x7f67040b39e0 2023-08-25T09:42:47.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.527+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6704070fe0 con 0x7f66f006a080 2023-08-25T09:42:47.535 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.533+0000 7f6700ff9640 1 -- 172.21.15.89:0/33494488 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281444 (secure 0 0 0) 0x7f66f4031c40 con 0x7f66f006a080 2023-08-25T09:42:47.539 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:47.541 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:47.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f66f006a080 msgr2=0x7f66f006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f66f006a080 0x7f66f006c540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66f4036000 tx=0x7f66f403c040 comp rx=0 tx=0).stop 2023-08-25T09:42:47.543 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 msgr2=0x7f670413a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 0x7f670413a3a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66f800b3f0 tx=0x7f66f800b8b0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 shutdown_connections 2023-08-25T09:42:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f66f006a080 0x7f66f006c540 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67040b39e0 0x7f670413a3a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67040b7340 0x7f670413a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 --2- 172.21.15.89:0/33494488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704070c00 0x7f6704141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 >> 172.21.15.89:0/33494488 conn(0x7f6704069a30 msgr2=0x7f670413edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 shutdown_connections 2023-08-25T09:42:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.536+0000 7f670a614640 1 -- 172.21.15.89:0/33494488 wait complete. 2023-08-25T09:42:47.549 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-08-25T09:42:46.509077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2285552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.259671"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261734+0000","last_change":"2023-08-25T09:42:43.261734+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261734+0000","last_undegraded":"2023-08-25T09:42:43.261734+0000","last_fullsized":"2023-08-25T09:42:43.261734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263965+0000","last_change":"2023-08-25T09:42:43.263965+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263965+0000","last_undegraded":"2023-08-25T09:42:43.263965+0000","last_fullsized":"2023-08-25T09:42:43.263965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260230+0000","last_change":"2023-08-25T09:42:43.260230+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260230+0000","last_undegraded":"2023-08-25T09:42:43.260230+0000","last_fullsized":"2023-08-25T09:42:43.260230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263677+0000","last_change":"2023-08-25T09:42:43.263677+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263677+0000","last_undegraded":"2023-08-25T09:42:43.263677+0000","last_fullsized":"2023-08-25T09:42:43.263677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262321+0000","last_change":"2023-08-25T09:42:43.262321+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262321+0000","last_undegraded":"2023-08-25T09:42:43.262321+0000","last_fullsized":"2023-08-25T09:42:43.262321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261944+0000","last_change":"2023-08-25T09:42:43.261944+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261944+0000","last_undegraded":"2023-08-25T09:42:43.261944+0000","last_fullsized":"2023-08-25T09:42:43.261944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264994+0000","last_change":"2023-08-25T09:42:43.264994+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264994+0000","last_undegraded":"2023-08-25T09:42:43.264994+0000","last_fullsized":"2023-08-25T09:42:43.264994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262073+0000","last_change":"2023-08-25T09:42:43.262073+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262073+0000","last_undegraded":"2023-08-25T09:42:43.262073+0000","last_fullsized":"2023-08-25T09:42:43.262073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259390+0000","last_change":"2023-08-25T09:42:43.259390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259390+0000","last_undegraded":"2023-08-25T09:42:43.259390+0000","last_fullsized":"2023-08-25T09:42:43.259390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263942+0000","last_change":"2023-08-25T09:42:43.263942+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263942+0000","last_undegraded":"2023-08-25T09:42:43.263942+0000","last_fullsized":"2023-08-25T09:42:43.263942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263245+0000","last_change":"2023-08-25T09:42:43.263245+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263245+0000","last_undegraded":"2023-08-25T09:42:43.263245+0000","last_fullsized":"2023-08-25T09:42:43.263245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260368+0000","last_change":"2023-08-25T09:42:43.260368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260368+0000","last_undegraded":"2023-08-25T09:42:43.260368+0000","last_fullsized":"2023-08-25T09:42:43.260368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262375+0000","last_change":"2023-08-25T09:42:43.262375+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262375+0000","last_undegraded":"2023-08-25T09:42:43.262375+0000","last_fullsized":"2023-08-25T09:42:43.262375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260475+0000","last_change":"2023-08-25T09:42:43.260475+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260475+0000","last_undegraded":"2023-08-25T09:42:43.260475+0000","last_fullsized":"2023-08-25T09:42:43.260475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264083+0000","last_change":"2023-08-25T09:42:43.264083+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264083+0000","last_undegraded":"2023-08-25T09:42:43.264083+0000","last_fullsized":"2023-08-25T09:42:43.264083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264112+0000","last_change":"2023-08-25T09:42:43.264112+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264112+0000","last_undegraded":"2023-08-25T09:42:43.264112+0000","last_fullsized":"2023-08-25T09:42:43.264112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263584+0000","last_change":"2023-08-25T09:42:43.263584+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263584+0000","last_undegraded":"2023-08-25T09:42:43.263584+0000","last_fullsized":"2023-08-25T09:42:43.263584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262805+0000","last_change":"2023-08-25T09:42:43.262805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262805+0000","last_undegraded":"2023-08-25T09:42:43.262805+0000","last_fullsized":"2023-08-25T09:42:43.262805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261226+0000","last_change":"2023-08-25T09:42:43.261226+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261226+0000","last_undegraded":"2023-08-25T09:42:43.261226+0000","last_fullsized":"2023-08-25T09:42:43.261226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265721+0000","last_change":"2023-08-25T09:42:43.265721+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265721+0000","last_undegraded":"2023-08-25T09:42:43.265721+0000","last_fullsized":"2023-08-25T09:42:43.265721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263420+0000","last_change":"2023-08-25T09:42:43.263420+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263420+0000","last_undegraded":"2023-08-25T09:42:43.263420+0000","last_fullsized":"2023-08-25T09:42:43.263420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258833+0000","last_change":"2023-08-25T09:42:43.258833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258833+0000","last_undegraded":"2023-08-25T09:42:43.258833+0000","last_fullsized":"2023-08-25T09:42:43.258833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265206+0000","last_change":"2023-08-25T09:42:43.265206+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265206+0000","last_undegraded":"2023-08-25T09:42:43.265206+0000","last_fullsized":"2023-08-25T09:42:43.265206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262857+0000","last_change":"2023-08-25T09:42:43.262857+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262857+0000","last_undegraded":"2023-08-25T09:42:43.262857+0000","last_fullsized":"2023-08-25T09:42:43.262857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263805+0000","last_change":"2023-08-25T09:42:43.263805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263805+0000","last_undegraded":"2023-08-25T09:42:43.263805+0000","last_fullsized":"2023-08-25T09:42:43.263805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262743+0000","last_change":"2023-08-25T09:42:43.262743+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262743+0000","last_undegraded":"2023-08-25T09:42:43.262743+0000","last_fullsized":"2023-08-25T09:42:43.262743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264893+0000","last_change":"2023-08-25T09:42:43.264893+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264893+0000","last_undegraded":"2023-08-25T09:42:43.264893+0000","last_fullsized":"2023-08-25T09:42:43.264893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263506+0000","last_change":"2023-08-25T09:42:43.263506+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263506+0000","last_undegraded":"2023-08-25T09:42:43.263506+0000","last_fullsized":"2023-08-25T09:42:43.263506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.266155+0000","last_change":"2023-08-25T09:42:43.266155+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.266155+0000","last_undegraded":"2023-08-25T09:42:43.266155+0000","last_fullsized":"2023-08-25T09:42:43.266155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262663+0000","last_change":"2023-08-25T09:42:43.262663+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262663+0000","last_undegraded":"2023-08-25T09:42:43.262663+0000","last_fullsized":"2023-08-25T09:42:43.262663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263511+0000","last_change":"2023-08-25T09:42:43.263511+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263511+0000","last_undegraded":"2023-08-25T09:42:43.263511+0000","last_fullsized":"2023-08-25T09:42:43.263511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261258+0000","last_change":"2023-08-25T09:42:43.261258+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261258+0000","last_undegraded":"2023-08-25T09:42:43.261258+0000","last_fullsized":"2023-08-25T09:42:43.261258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265686+0000","last_change":"2023-08-25T09:42:43.265686+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265686+0000","last_undegraded":"2023-08-25T09:42:43.265686+0000","last_fullsized":"2023-08-25T09:42:43.265686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275831+0000","last_change":"2023-08-25T09:42:43.274652+0000","last_active":"2023-08-25T09:42:43.275831+0000","last_peered":"2023-08-25T09:42:43.275831+0000","last_clean":"2023-08-25T09:42:43.275831+0000","last_became_active":"2023-08-25T09:42:43.274360+0000","last_became_peered":"2023-08-25T09:42:43.274360+0000","last_unstale":"2023-08-25T09:42:43.275831+0000","last_undegraded":"2023-08-25T09:42:43.275831+0000","last_fullsized":"2023-08-25T09:42:43.275831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:10.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260708+0000","last_change":"2023-08-25T09:42:43.260708+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260708+0000","last_undegraded":"2023-08-25T09:42:43.260708+0000","last_fullsized":"2023-08-25T09:42:43.260708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274478+0000","last_change":"2023-08-25T09:42:43.269611+0000","last_active":"2023-08-25T09:42:43.274478+0000","last_peered":"2023-08-25T09:42:43.274478+0000","last_clean":"2023-08-25T09:42:43.274478+0000","last_became_active":"2023-08-25T09:42:43.269334+0000","last_became_peered":"2023-08-25T09:42:43.269334+0000","last_unstale":"2023-08-25T09:42:43.274478+0000","last_undegraded":"2023-08-25T09:42:43.274478+0000","last_fullsized":"2023-08-25T09:42:43.274478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:57:42.803780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259397+0000","last_change":"2023-08-25T09:42:43.259397+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259397+0000","last_undegraded":"2023-08-25T09:42:43.259397+0000","last_fullsized":"2023-08-25T09:42:43.259397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274336+0000","last_change":"2023-08-25T09:42:43.270208+0000","last_active":"2023-08-25T09:42:43.274336+0000","last_peered":"2023-08-25T09:42:43.274336+0000","last_clean":"2023-08-25T09:42:43.274336+0000","last_became_active":"2023-08-25T09:42:43.269906+0000","last_became_peered":"2023-08-25T09:42:43.269906+0000","last_unstale":"2023-08-25T09:42:43.274336+0000","last_undegraded":"2023-08-25T09:42:43.274336+0000","last_fullsized":"2023-08-25T09:42:43.274336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:33.970812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261188+0000","last_change":"2023-08-25T09:42:43.261188+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261188+0000","last_undegraded":"2023-08-25T09:42:43.261188+0000","last_fullsized":"2023-08-25T09:42:43.261188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273929+0000","last_change":"2023-08-25T09:42:43.269894+0000","last_active":"2023-08-25T09:42:43.273929+0000","last_peered":"2023-08-25T09:42:43.273929+0000","last_clean":"2023-08-25T09:42:43.273929+0000","last_became_active":"2023-08-25T09:42:43.269588+0000","last_became_peered":"2023-08-25T09:42:43.269588+0000","last_unstale":"2023-08-25T09:42:43.273929+0000","last_undegraded":"2023-08-25T09:42:43.273929+0000","last_fullsized":"2023-08-25T09:42:43.273929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:23.583856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261390+0000","last_change":"2023-08-25T09:42:43.261390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261390+0000","last_undegraded":"2023-08-25T09:42:43.261390+0000","last_fullsized":"2023-08-25T09:42:43.261390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276184+0000","last_change":"2023-08-25T09:42:43.274532+0000","last_active":"2023-08-25T09:42:43.276184+0000","last_peered":"2023-08-25T09:42:43.276184+0000","last_clean":"2023-08-25T09:42:43.276184+0000","last_became_active":"2023-08-25T09:42:43.274259+0000","last_became_peered":"2023-08-25T09:42:43.274259+0000","last_unstale":"2023-08-25T09:42:43.276184+0000","last_undegraded":"2023-08-25T09:42:43.276184+0000","last_fullsized":"2023-08-25T09:42:43.276184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263486+0000","last_change":"2023-08-25T09:42:43.263486+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263486+0000","last_undegraded":"2023-08-25T09:42:43.263486+0000","last_fullsized":"2023-08-25T09:42:43.263486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272496+0000","last_change":"2023-08-25T09:42:43.271395+0000","last_active":"2023-08-25T09:42:43.272496+0000","last_peered":"2023-08-25T09:42:43.272496+0000","last_clean":"2023-08-25T09:42:43.272496+0000","last_became_active":"2023-08-25T09:42:43.271122+0000","last_became_peered":"2023-08-25T09:42:43.271122+0000","last_unstale":"2023-08-25T09:42:43.272496+0000","last_undegraded":"2023-08-25T09:42:43.272496+0000","last_fullsized":"2023-08-25T09:42:43.272496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:19.767009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259595+0000","last_change":"2023-08-25T09:42:43.259595+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259595+0000","last_undegraded":"2023-08-25T09:42:43.259595+0000","last_fullsized":"2023-08-25T09:42:43.259595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277824+0000","last_change":"2023-08-25T09:42:43.275402+0000","last_active":"2023-08-25T09:42:43.277824+0000","last_peered":"2023-08-25T09:42:43.277824+0000","last_clean":"2023-08-25T09:42:43.277824+0000","last_became_active":"2023-08-25T09:42:43.275116+0000","last_became_peered":"2023-08-25T09:42:43.275116+0000","last_unstale":"2023-08-25T09:42:43.277824+0000","last_undegraded":"2023-08-25T09:42:43.277824+0000","last_fullsized":"2023-08-25T09:42:43.277824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264298+0000","last_change":"2023-08-25T09:42:43.264298+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264298+0000","last_undegraded":"2023-08-25T09:42:43.264298+0000","last_fullsized":"2023-08-25T09:42:43.264298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272105+0000","last_change":"2023-08-25T09:42:43.269075+0000","last_active":"2023-08-25T09:42:43.272105+0000","last_peered":"2023-08-25T09:42:43.272105+0000","last_clean":"2023-08-25T09:42:43.272105+0000","last_became_active":"2023-08-25T09:42:43.268787+0000","last_became_peered":"2023-08-25T09:42:43.268787+0000","last_unstale":"2023-08-25T09:42:43.272105+0000","last_undegraded":"2023-08-25T09:42:43.272105+0000","last_fullsized":"2023-08-25T09:42:43.272105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:05.324298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263139+0000","last_change":"2023-08-25T09:42:43.263139+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263139+0000","last_undegraded":"2023-08-25T09:42:43.263139+0000","last_fullsized":"2023-08-25T09:42:43.263139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269087+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269087+0000","last_peered":"2023-08-25T09:42:43.269087+0000","last_clean":"2023-08-25T09:42:43.269087+0000","last_became_active":"2023-08-25T09:42:43.265064+0000","last_became_peered":"2023-08-25T09:42:43.265064+0000","last_unstale":"2023-08-25T09:42:43.269087+0000","last_undegraded":"2023-08-25T09:42:43.269087+0000","last_fullsized":"2023-08-25T09:42:43.269087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:30:21.363562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262964+0000","last_change":"2023-08-25T09:42:43.262964+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262964+0000","last_undegraded":"2023-08-25T09:42:43.262964+0000","last_fullsized":"2023-08-25T09:42:43.262964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277387+0000","last_change":"2023-08-25T09:42:43.276586+0000","last_active":"2023-08-25T09:42:43.277387+0000","last_peered":"2023-08-25T09:42:43.277387+0000","last_clean":"2023-08-25T09:42:43.277387+0000","last_became_active":"2023-08-25T09:42:43.276311+0000","last_became_peered":"2023-08-25T09:42:43.276311+0000","last_unstale":"2023-08-25T09:42:43.277387+0000","last_undegraded":"2023-08-25T09:42:43.277387+0000","last_fullsized":"2023-08-25T09:42:43.277387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:17:09.330315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263305+0000","last_change":"2023-08-25T09:42:43.263305+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263305+0000","last_undegraded":"2023-08-25T09:42:43.263305+0000","last_fullsized":"2023-08-25T09:42:43.263305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276924+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.276924+0000","last_peered":"2023-08-25T09:42:43.276924+0000","last_clean":"2023-08-25T09:42:43.276924+0000","last_became_active":"2023-08-25T09:42:43.275295+0000","last_became_peered":"2023-08-25T09:42:43.275295+0000","last_unstale":"2023-08-25T09:42:43.276924+0000","last_undegraded":"2023-08-25T09:42:43.276924+0000","last_fullsized":"2023-08-25T09:42:43.276924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:37.726279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258959+0000","last_change":"2023-08-25T09:42:43.258959+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258959+0000","last_undegraded":"2023-08-25T09:42:43.258959+0000","last_fullsized":"2023-08-25T09:42:43.258959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271742+0000","last_change":"2023-08-25T09:42:43.268508+0000","last_active":"2023-08-25T09:42:43.271742+0000","last_peered":"2023-08-25T09:42:43.271742+0000","last_clean":"2023-08-25T09:42:43.271742+0000","last_became_active":"2023-08-25T09:42:43.268143+0000","last_became_peered":"2023-08-25T09:42:43.268143+0000","last_unstale":"2023-08-25T09:42:43.271742+0000","last_undegraded":"2023-08-25T09:42:43.271742+0000","last_fullsized":"2023-08-25T09:42:43.271742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:38:14.600448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259876+0000","last_change":"2023-08-25T09:42:43.259876+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259876+0000","last_undegraded":"2023-08-25T09:42:43.259876+0000","last_fullsized":"2023-08-25T09:42:43.259876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271668+0000","last_change":"2023-08-25T09:42:43.267210+0000","last_active":"2023-08-25T09:42:43.271668+0000","last_peered":"2023-08-25T09:42:43.271668+0000","last_clean":"2023-08-25T09:42:43.271668+0000","last_became_active":"2023-08-25T09:42:43.266940+0000","last_became_peered":"2023-08-25T09:42:43.266940+0000","last_unstale":"2023-08-25T09:42:43.271668+0000","last_undegraded":"2023-08-25T09:42:43.271668+0000","last_fullsized":"2023-08-25T09:42:43.271668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261573+0000","last_change":"2023-08-25T09:42:43.261573+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261573+0000","last_undegraded":"2023-08-25T09:42:43.261573+0000","last_fullsized":"2023-08-25T09:42:43.261573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278080+0000","last_change":"2023-08-25T09:42:43.276967+0000","last_active":"2023-08-25T09:42:43.278080+0000","last_peered":"2023-08-25T09:42:43.278080+0000","last_clean":"2023-08-25T09:42:43.278080+0000","last_became_active":"2023-08-25T09:42:43.276646+0000","last_became_peered":"2023-08-25T09:42:43.276646+0000","last_unstale":"2023-08-25T09:42:43.278080+0000","last_undegraded":"2023-08-25T09:42:43.278080+0000","last_fullsized":"2023-08-25T09:42:43.278080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262991+0000","last_change":"2023-08-25T09:42:43.262991+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262991+0000","last_undegraded":"2023-08-25T09:42:43.262991+0000","last_fullsized":"2023-08-25T09:42:43.262991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275811+0000","last_change":"2023-08-25T09:42:43.274167+0000","last_active":"2023-08-25T09:42:43.275811+0000","last_peered":"2023-08-25T09:42:43.275811+0000","last_clean":"2023-08-25T09:42:43.275811+0000","last_became_active":"2023-08-25T09:42:43.273457+0000","last_became_peered":"2023-08-25T09:42:43.273457+0000","last_unstale":"2023-08-25T09:42:43.275811+0000","last_undegraded":"2023-08-25T09:42:43.275811+0000","last_fullsized":"2023-08-25T09:42:43.275811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:49.533731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263833+0000","last_change":"2023-08-25T09:42:43.263833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263833+0000","last_undegraded":"2023-08-25T09:42:43.263833+0000","last_fullsized":"2023-08-25T09:42:43.263833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276310+0000","last_change":"2023-08-25T09:42:43.273820+0000","last_active":"2023-08-25T09:42:43.276310+0000","last_peered":"2023-08-25T09:42:43.276310+0000","last_clean":"2023-08-25T09:42:43.276310+0000","last_became_active":"2023-08-25T09:42:43.273362+0000","last_became_peered":"2023-08-25T09:42:43.273362+0000","last_unstale":"2023-08-25T09:42:43.276310+0000","last_undegraded":"2023-08-25T09:42:43.276310+0000","last_fullsized":"2023-08-25T09:42:43.276310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:30:11.556739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264574+0000","last_change":"2023-08-25T09:42:43.264574+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264574+0000","last_undegraded":"2023-08-25T09:42:43.264574+0000","last_fullsized":"2023-08-25T09:42:43.264574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277358+0000","last_change":"2023-08-25T09:42:43.276386+0000","last_active":"2023-08-25T09:42:43.277358+0000","last_peered":"2023-08-25T09:42:43.277358+0000","last_clean":"2023-08-25T09:42:43.277358+0000","last_became_active":"2023-08-25T09:42:43.276029+0000","last_became_peered":"2023-08-25T09:42:43.276029+0000","last_unstale":"2023-08-25T09:42:43.277358+0000","last_undegraded":"2023-08-25T09:42:43.277358+0000","last_fullsized":"2023-08-25T09:42:43.277358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:10.071794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262312+0000","last_change":"2023-08-25T09:42:43.262312+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262312+0000","last_undegraded":"2023-08-25T09:42:43.262312+0000","last_fullsized":"2023-08-25T09:42:43.262312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275617+0000","last_change":"2023-08-25T09:42:43.273234+0000","last_active":"2023-08-25T09:42:43.275617+0000","last_peered":"2023-08-25T09:42:43.275617+0000","last_clean":"2023-08-25T09:42:43.275617+0000","last_became_active":"2023-08-25T09:42:43.272846+0000","last_became_peered":"2023-08-25T09:42:43.272846+0000","last_unstale":"2023-08-25T09:42:43.275617+0000","last_undegraded":"2023-08-25T09:42:43.275617+0000","last_fullsized":"2023-08-25T09:42:43.275617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:22:28.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259960+0000","last_change":"2023-08-25T09:42:43.259960+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259960+0000","last_undegraded":"2023-08-25T09:42:43.259960+0000","last_fullsized":"2023-08-25T09:42:43.259960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274963+0000","last_change":"2023-08-25T09:42:43.271438+0000","last_active":"2023-08-25T09:42:43.274963+0000","last_peered":"2023-08-25T09:42:43.274963+0000","last_clean":"2023-08-25T09:42:43.274963+0000","last_became_active":"2023-08-25T09:42:43.271184+0000","last_became_peered":"2023-08-25T09:42:43.271184+0000","last_unstale":"2023-08-25T09:42:43.274963+0000","last_undegraded":"2023-08-25T09:42:43.274963+0000","last_fullsized":"2023-08-25T09:42:43.274963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:48.671798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260382+0000","last_change":"2023-08-25T09:42:43.260382+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260382+0000","last_undegraded":"2023-08-25T09:42:43.260382+0000","last_fullsized":"2023-08-25T09:42:43.260382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274356+0000","last_change":"2023-08-25T09:42:43.270977+0000","last_active":"2023-08-25T09:42:43.274356+0000","last_peered":"2023-08-25T09:42:43.274356+0000","last_clean":"2023-08-25T09:42:43.274356+0000","last_became_active":"2023-08-25T09:42:43.270702+0000","last_became_peered":"2023-08-25T09:42:43.270702+0000","last_unstale":"2023-08-25T09:42:43.274356+0000","last_undegraded":"2023-08-25T09:42:43.274356+0000","last_fullsized":"2023-08-25T09:42:43.274356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:21.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262444+0000","last_change":"2023-08-25T09:42:43.262444+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262444+0000","last_undegraded":"2023-08-25T09:42:43.262444+0000","last_fullsized":"2023-08-25T09:42:43.262444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274363+0000","last_change":"2023-08-25T09:42:43.268849+0000","last_active":"2023-08-25T09:42:43.274363+0000","last_peered":"2023-08-25T09:42:43.274363+0000","last_clean":"2023-08-25T09:42:43.274363+0000","last_became_active":"2023-08-25T09:42:43.268561+0000","last_became_peered":"2023-08-25T09:42:43.268561+0000","last_unstale":"2023-08-25T09:42:43.274363+0000","last_undegraded":"2023-08-25T09:42:43.274363+0000","last_fullsized":"2023-08-25T09:42:43.274363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:35:49.609217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259747+0000","last_change":"2023-08-25T09:42:43.259747+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259747+0000","last_undegraded":"2023-08-25T09:42:43.259747+0000","last_fullsized":"2023-08-25T09:42:43.259747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274213+0000","last_change":"2023-08-25T09:42:43.267133+0000","last_active":"2023-08-25T09:42:43.274213+0000","last_peered":"2023-08-25T09:42:43.274213+0000","last_clean":"2023-08-25T09:42:43.274213+0000","last_became_active":"2023-08-25T09:42:43.266868+0000","last_became_peered":"2023-08-25T09:42:43.266868+0000","last_unstale":"2023-08-25T09:42:43.274213+0000","last_undegraded":"2023-08-25T09:42:43.274213+0000","last_fullsized":"2023-08-25T09:42:43.274213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:04.490031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261974+0000","last_change":"2023-08-25T09:42:43.261974+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261974+0000","last_undegraded":"2023-08-25T09:42:43.261974+0000","last_fullsized":"2023-08-25T09:42:43.261974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272464+0000","last_change":"2023-08-25T09:42:43.270692+0000","last_active":"2023-08-25T09:42:43.272464+0000","last_peered":"2023-08-25T09:42:43.272464+0000","last_clean":"2023-08-25T09:42:43.272464+0000","last_became_active":"2023-08-25T09:42:43.270431+0000","last_became_peered":"2023-08-25T09:42:43.270431+0000","last_unstale":"2023-08-25T09:42:43.272464+0000","last_undegraded":"2023-08-25T09:42:43.272464+0000","last_fullsized":"2023-08-25T09:42:43.272464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259665+0000","last_change":"2023-08-25T09:42:43.259665+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259665+0000","last_undegraded":"2023-08-25T09:42:43.259665+0000","last_fullsized":"2023-08-25T09:42:43.259665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274915+0000","last_change":"2023-08-25T09:42:43.270252+0000","last_active":"2023-08-25T09:42:43.274915+0000","last_peered":"2023-08-25T09:42:43.274915+0000","last_clean":"2023-08-25T09:42:43.274915+0000","last_became_active":"2023-08-25T09:42:43.269931+0000","last_became_peered":"2023-08-25T09:42:43.269931+0000","last_unstale":"2023-08-25T09:42:43.274915+0000","last_undegraded":"2023-08-25T09:42:43.274915+0000","last_fullsized":"2023-08-25T09:42:43.274915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:39:53.965422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262501+0000","last_change":"2023-08-25T09:42:43.262501+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262501+0000","last_undegraded":"2023-08-25T09:42:43.262501+0000","last_fullsized":"2023-08-25T09:42:43.262501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276362+0000","last_change":"2023-08-25T09:42:43.275120+0000","last_active":"2023-08-25T09:42:43.276362+0000","last_peered":"2023-08-25T09:42:43.276362+0000","last_clean":"2023-08-25T09:42:43.276362+0000","last_became_active":"2023-08-25T09:42:43.274864+0000","last_became_peered":"2023-08-25T09:42:43.274864+0000","last_unstale":"2023-08-25T09:42:43.276362+0000","last_undegraded":"2023-08-25T09:42:43.276362+0000","last_fullsized":"2023-08-25T09:42:43.276362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:38.615225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266390+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:43.266390+0000","last_peered":"2023-08-25T09:42:43.266390+0000","last_clean":"2023-08-25T09:42:43.266390+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:43.266390+0000","last_undegraded":"2023-08-25T09:42:43.266390+0000","last_fullsized":"2023-08-25T09:42:43.266390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:21:35.220456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271808+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:43.271808+0000","last_peered":"2023-08-25T09:42:43.271808+0000","last_clean":"2023-08-25T09:42:43.271808+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:43.271808+0000","last_undegraded":"2023-08-25T09:42:43.271808+0000","last_fullsized":"2023-08-25T09:42:43.271808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:50:11.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261413+0000","last_change":"2023-08-25T09:42:43.261413+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261413+0000","last_undegraded":"2023-08-25T09:42:43.261413+0000","last_fullsized":"2023-08-25T09:42:43.261413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277049+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.277049+0000","last_peered":"2023-08-25T09:42:43.277049+0000","last_clean":"2023-08-25T09:42:43.277049+0000","last_became_active":"2023-08-25T09:42:43.275237+0000","last_became_peered":"2023-08-25T09:42:43.275237+0000","last_unstale":"2023-08-25T09:42:43.277049+0000","last_undegraded":"2023-08-25T09:42:43.277049+0000","last_fullsized":"2023-08-25T09:42:43.277049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:49.486016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266259+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:43.266259+0000","last_peered":"2023-08-25T09:42:43.266259+0000","last_clean":"2023-08-25T09:42:43.266259+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:43.266259+0000","last_undegraded":"2023-08-25T09:42:43.266259+0000","last_fullsized":"2023-08-25T09:42:43.266259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:04:36.548473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262490+0000","last_change":"2023-08-25T09:42:43.262490+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262490+0000","last_undegraded":"2023-08-25T09:42:43.262490+0000","last_fullsized":"2023-08-25T09:42:43.262490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278134+0000","last_change":"2023-08-25T09:42:43.276569+0000","last_active":"2023-08-25T09:42:43.278134+0000","last_peered":"2023-08-25T09:42:43.278134+0000","last_clean":"2023-08-25T09:42:43.278134+0000","last_became_active":"2023-08-25T09:42:43.276306+0000","last_became_peered":"2023-08-25T09:42:43.276306+0000","last_unstale":"2023-08-25T09:42:43.278134+0000","last_undegraded":"2023-08-25T09:42:43.278134+0000","last_fullsized":"2023-08-25T09:42:43.278134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:12:20.185119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.259490+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:43.259490+0000","last_peered":"2023-08-25T09:42:43.259490+0000","last_clean":"2023-08-25T09:42:43.259490+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:43.259490+0000","last_undegraded":"2023-08-25T09:42:43.259490+0000","last_fullsized":"2023-08-25T09:42:43.259490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:19.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262174+0000","last_change":"2023-08-25T09:42:43.262174+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262174+0000","last_undegraded":"2023-08-25T09:42:43.262174+0000","last_fullsized":"2023-08-25T09:42:43.262174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269613+0000","last_change":"2023-08-25T09:42:43.267196+0000","last_active":"2023-08-25T09:42:43.269613+0000","last_peered":"2023-08-25T09:42:43.269613+0000","last_clean":"2023-08-25T09:42:43.269613+0000","last_became_active":"2023-08-25T09:42:43.266945+0000","last_became_peered":"2023-08-25T09:42:43.266945+0000","last_unstale":"2023-08-25T09:42:43.269613+0000","last_undegraded":"2023-08-25T09:42:43.269613+0000","last_fullsized":"2023-08-25T09:42:43.269613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:13:03.220760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271657+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:43.271657+0000","last_peered":"2023-08-25T09:42:43.271657+0000","last_clean":"2023-08-25T09:42:43.271657+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:43.271657+0000","last_undegraded":"2023-08-25T09:42:43.271657+0000","last_fullsized":"2023-08-25T09:42:43.271657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:01.957756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259368+0000","last_change":"2023-08-25T09:42:43.259368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259368+0000","last_undegraded":"2023-08-25T09:42:43.259368+0000","last_fullsized":"2023-08-25T09:42:43.259368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274716+0000","last_change":"2023-08-25T09:42:43.270865+0000","last_active":"2023-08-25T09:42:43.274716+0000","last_peered":"2023-08-25T09:42:43.274716+0000","last_clean":"2023-08-25T09:42:43.274716+0000","last_became_active":"2023-08-25T09:42:43.270528+0000","last_became_peered":"2023-08-25T09:42:43.270528+0000","last_unstale":"2023-08-25T09:42:43.274716+0000","last_undegraded":"2023-08-25T09:42:43.274716+0000","last_fullsized":"2023-08-25T09:42:43.274716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:02.604480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.261656+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:43.261656+0000","last_peered":"2023-08-25T09:42:43.261656+0000","last_clean":"2023-08-25T09:42:43.261656+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:43.261656+0000","last_undegraded":"2023-08-25T09:42:43.261656+0000","last_fullsized":"2023-08-25T09:42:43.261656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:23.036411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259879+0000","last_change":"2023-08-25T09:42:43.259879+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259879+0000","last_undegraded":"2023-08-25T09:42:43.259879+0000","last_fullsized":"2023-08-25T09:42:43.259879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272362+0000","last_change":"2023-08-25T09:42:43.270587+0000","last_active":"2023-08-25T09:42:43.272362+0000","last_peered":"2023-08-25T09:42:43.272362+0000","last_clean":"2023-08-25T09:42:43.272362+0000","last_became_active":"2023-08-25T09:42:43.270215+0000","last_became_peered":"2023-08-25T09:42:43.270215+0000","last_unstale":"2023-08-25T09:42:43.272362+0000","last_undegraded":"2023-08-25T09:42:43.272362+0000","last_fullsized":"2023-08-25T09:42:43.272362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:20.358964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266898+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:43.266898+0000","last_peered":"2023-08-25T09:42:43.266898+0000","last_clean":"2023-08-25T09:42:43.266898+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:43.266898+0000","last_undegraded":"2023-08-25T09:42:43.266898+0000","last_fullsized":"2023-08-25T09:42:43.266898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.288915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260072+0000","last_change":"2023-08-25T09:42:43.260072+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260072+0000","last_undegraded":"2023-08-25T09:42:43.260072+0000","last_fullsized":"2023-08-25T09:42:43.260072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273966+0000","last_change":"2023-08-25T09:42:43.269888+0000","last_active":"2023-08-25T09:42:43.273966+0000","last_peered":"2023-08-25T09:42:43.273966+0000","last_clean":"2023-08-25T09:42:43.273966+0000","last_became_active":"2023-08-25T09:42:43.269578+0000","last_became_peered":"2023-08-25T09:42:43.269578+0000","last_unstale":"2023-08-25T09:42:43.273966+0000","last_undegraded":"2023-08-25T09:42:43.273966+0000","last_fullsized":"2023-08-25T09:42:43.273966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.262969+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:43.262969+0000","last_peered":"2023-08-25T09:42:43.262969+0000","last_clean":"2023-08-25T09:42:43.262969+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:43.262969+0000","last_undegraded":"2023-08-25T09:42:43.262969+0000","last_fullsized":"2023-08-25T09:42:43.262969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:02.450633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264885+0000","last_change":"2023-08-25T09:42:43.264885+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264885+0000","last_undegraded":"2023-08-25T09:42:43.264885+0000","last_fullsized":"2023-08-25T09:42:43.264885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269004+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269004+0000","last_peered":"2023-08-25T09:42:43.269004+0000","last_clean":"2023-08-25T09:42:43.269004+0000","last_became_active":"2023-08-25T09:42:43.265091+0000","last_became_peered":"2023-08-25T09:42:43.265091+0000","last_unstale":"2023-08-25T09:42:43.269004+0000","last_undegraded":"2023-08-25T09:42:43.269004+0000","last_fullsized":"2023-08-25T09:42:43.269004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:44:40.542410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.264119+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:43.264119+0000","last_peered":"2023-08-25T09:42:43.264119+0000","last_clean":"2023-08-25T09:42:43.264119+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:43.264119+0000","last_undegraded":"2023-08-25T09:42:43.264119+0000","last_fullsized":"2023-08-25T09:42:43.264119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:54.470307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":726813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":733441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:47.559 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:47.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.686+0000 7f5265779640 1 Processor -- start 2023-08-25T09:42:47.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.686+0000 7f5265779640 1 -- start start 2023-08-25T09:42:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f5265779640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f52601494a0 0x7f526006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f5265779640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5260149010 con 0x7f526006eba0 2023-08-25T09:42:47.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f5265779640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52601489c0 con 0x7f52600b4a90 2023-08-25T09:42:47.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f5265779640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600b52e0 con 0x7f52601494a0 2023-08-25T09:42:47.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f525effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f526006eba0 0x7f526006d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40760/0 (socket says 172.21.15.89:40760) 2023-08-25T09:42:47.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f525effd640 1 -- 172.21.15.89:0/3570809795 learned_addr learned my addr 172.21.15.89:0/3570809795 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:47.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f525e7fc640 1 --2- 172.21.15.89:0/3570809795 >> v2:172.21.15.121:3300/0 conn(0x7f52601494a0 0x7f526006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795770266 0 0) 0x7f5260149010 con 0x7f526006eba0 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5248003520 con 0x7f526006eba0 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.687+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 696176873 0 0) 0x7f5248003520 con 0x7f526006eba0 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 >> v2:172.21.15.121:3300/0 conn(0x7f52601494a0 msgr2=0x7f526006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 --2- 172.21.15.89:0/3570809795 >> v2:172.21.15.121:3300/0 conn(0x7f52601494a0 0x7f526006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 >> v1:172.21.15.121:6789/0 conn(0x7f52600b4a90 legacy=0x7f52600b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260148ca0 con 0x7f526006eba0 2023-08-25T09:42:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f5250001b70 con 0x7f526006eba0 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 >> v1:172.21.15.89:6789/0 conn(0x7f526006eba0 legacy=0x7f526006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480039e0 0x7f5248003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52480047c0 0x7f5248004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52480051f0 0x7f524800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600b52e0 con 0x7f52480047c0 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524800c150 con 0x7f52480039e0 2023-08-25T09:42:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524800c310 con 0x7f52480051f0 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525e7fc640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52480047c0 0x7f5248004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525effd640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480039e0 0x7f5248003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525f7fe640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52480051f0 0x7f524800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525e7fc640 1 -- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52480051f0 msgr2=0x7f524800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525e7fc640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52480051f0 0x7f524800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525e7fc640 1 -- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480039e0 msgr2=0x7f5248003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525e7fc640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480039e0 0x7f5248003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525e7fc640 1 -- 172.21.15.89:0/3570809795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5248003520 con 0x7f52480047c0 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.688+0000 7f525f7fe640 1 -- 172.21.15.89:0/3570809795 reap_dead start 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f525e7fc640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52480047c0 0x7f5248004c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5254009ac0 tx=0x7f52480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bd6b114a8b4190 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525402c6d0 con 0x7f52480047c0 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525402c830 con 0x7f52480047c0 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f525dffb640 1 -- 172.21.15.89:0/3570809795 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525402cbc0 con 0x7f52480047c0 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 -- 172.21.15.89:0/3570809795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52480047c0 msgr2=0x7f5248004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52480047c0 0x7f5248004c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5254009ac0 tx=0x7f52480057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 -- 172.21.15.89:0/3570809795 shutdown_connections 2023-08-25T09:42:47.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 --2- 172.21.15.89:0/3570809795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52480047c0 0x7f5248004c40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 -- 172.21.15.89:0/3570809795 >> 172.21.15.89:0/3570809795 conn(0x7f52600be090 msgr2=0x7f52600be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:47.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 -- 172.21.15.89:0/3570809795 shutdown_connections 2023-08-25T09:42:47.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.689+0000 7f5265779640 1 -- 172.21.15.89:0/3570809795 wait complete. 2023-08-25T09:42:47.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 Processor -- start 2023-08-25T09:42:47.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 -- start start 2023-08-25T09:42:47.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480047c0 0x7f526013d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5260149b50 0x7f5260149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 0x7f526013b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526013da90 con 0x7f526013b170 2023-08-25T09:42:47.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526014a510 con 0x7f52480047c0 2023-08-25T09:42:47.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f5265779640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526014bb10 con 0x7f5260149b50 2023-08-25T09:42:47.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 0x7f526013b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.706 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 0x7f526013b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35180/0 (socket says 172.21.15.89:35180) 2023-08-25T09:42:47.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 -- 172.21.15.89:0/1247455393 learned_addr learned my addr 172.21.15.89:0/1247455393 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:47.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525e7fc640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5260149b50 0x7f5260149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525effd640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480047c0 0x7f526013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 -- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5260149b50 msgr2=0x7f5260149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5260149b50 0x7f5260149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 -- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480047c0 msgr2=0x7f526013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480047c0 0x7f526013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.691+0000 7f525f7fe640 1 -- 172.21.15.89:0/1247455393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526014bdf0 con 0x7f526013b170 2023-08-25T09:42:47.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.692+0000 7f525f7fe640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 0x7f526013b620 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f52601430d0 tx=0x7f525800f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.692+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580053a0 con 0x7f526013b170 2023-08-25T09:42:47.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.692+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580035f0 con 0x7f526013b170 2023-08-25T09:42:47.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.692+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526014c0d0 con 0x7f526013b170 2023-08-25T09:42:47.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.692+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580039a0 con 0x7f526013b170 2023-08-25T09:42:47.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.692+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526014b570 con 0x7f526013b170 2023-08-25T09:42:47.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.693+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5260066c50 con 0x7f526013b170 2023-08-25T09:42:47.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.693+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5258003b00 con 0x7f526013b170 2023-08-25T09:42:47.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.694+0000 7f52477fe640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f524c06a050 0x7f524c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:47.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.694+0000 7f525effd640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f524c06a050 0x7f524c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:47.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.694+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52580881d0 con 0x7f526013b170 2023-08-25T09:42:47.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.694+0000 7f525effd640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f524c06a050 0x7f524c06c510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5250001270 tx=0x7f5250009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:47.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.698+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5258053970 con 0x7f526013b170 2023-08-25T09:42:47.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.861+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f526006ef80 con 0x7f524c06a050 2023-08-25T09:42:47.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.868+0000 7f52477fe640 1 -- 172.21.15.89:0/1247455393 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281444 (secure 0 0 0) 0x7f52500075c0 con 0x7f524c06a050 2023-08-25T09:42:47.874 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f524c06a050 msgr2=0x7f524c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f524c06a050 0x7f524c06c510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5250001270 tx=0x7f5250009040 comp rx=0 tx=0).stop 2023-08-25T09:42:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 msgr2=0x7f526013b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 0x7f526013b620 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f52601430d0 tx=0x7f525800f920 comp rx=0 tx=0).stop 2023-08-25T09:42:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 shutdown_connections 2023-08-25T09:42:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f524c06a050 0x7f524c06c510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f526013b170 0x7f526013b620 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5260149b50 0x7f5260149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 --2- 172.21.15.89:0/1247455393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52480047c0 0x7f526013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 >> 172.21.15.89:0/1247455393 conn(0x7f52600be090 msgr2=0x7f526006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 shutdown_connections 2023-08-25T09:42:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:47.871+0000 7f5265779640 1 -- 172.21.15.89:0/1247455393 wait complete. 2023-08-25T09:42:47.883 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-08-25T09:42:46.509077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2285552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.259671"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261734+0000","last_change":"2023-08-25T09:42:43.261734+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261734+0000","last_undegraded":"2023-08-25T09:42:43.261734+0000","last_fullsized":"2023-08-25T09:42:43.261734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263965+0000","last_change":"2023-08-25T09:42:43.263965+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263965+0000","last_undegraded":"2023-08-25T09:42:43.263965+0000","last_fullsized":"2023-08-25T09:42:43.263965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260230+0000","last_change":"2023-08-25T09:42:43.260230+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260230+0000","last_undegraded":"2023-08-25T09:42:43.260230+0000","last_fullsized":"2023-08-25T09:42:43.260230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263677+0000","last_change":"2023-08-25T09:42:43.263677+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263677+0000","last_undegraded":"2023-08-25T09:42:43.263677+0000","last_fullsized":"2023-08-25T09:42:43.263677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262321+0000","last_change":"2023-08-25T09:42:43.262321+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262321+0000","last_undegraded":"2023-08-25T09:42:43.262321+0000","last_fullsized":"2023-08-25T09:42:43.262321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261944+0000","last_change":"2023-08-25T09:42:43.261944+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261944+0000","last_undegraded":"2023-08-25T09:42:43.261944+0000","last_fullsized":"2023-08-25T09:42:43.261944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264994+0000","last_change":"2023-08-25T09:42:43.264994+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264994+0000","last_undegraded":"2023-08-25T09:42:43.264994+0000","last_fullsized":"2023-08-25T09:42:43.264994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262073+0000","last_change":"2023-08-25T09:42:43.262073+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262073+0000","last_undegraded":"2023-08-25T09:42:43.262073+0000","last_fullsized":"2023-08-25T09:42:43.262073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259390+0000","last_change":"2023-08-25T09:42:43.259390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259390+0000","last_undegraded":"2023-08-25T09:42:43.259390+0000","last_fullsized":"2023-08-25T09:42:43.259390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263942+0000","last_change":"2023-08-25T09:42:43.263942+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263942+0000","last_undegraded":"2023-08-25T09:42:43.263942+0000","last_fullsized":"2023-08-25T09:42:43.263942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263245+0000","last_change":"2023-08-25T09:42:43.263245+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263245+0000","last_undegraded":"2023-08-25T09:42:43.263245+0000","last_fullsized":"2023-08-25T09:42:43.263245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260368+0000","last_change":"2023-08-25T09:42:43.260368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260368+0000","last_undegraded":"2023-08-25T09:42:43.260368+0000","last_fullsized":"2023-08-25T09:42:43.260368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262375+0000","last_change":"2023-08-25T09:42:43.262375+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262375+0000","last_undegraded":"2023-08-25T09:42:43.262375+0000","last_fullsized":"2023-08-25T09:42:43.262375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260475+0000","last_change":"2023-08-25T09:42:43.260475+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260475+0000","last_undegraded":"2023-08-25T09:42:43.260475+0000","last_fullsized":"2023-08-25T09:42:43.260475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264083+0000","last_change":"2023-08-25T09:42:43.264083+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264083+0000","last_undegraded":"2023-08-25T09:42:43.264083+0000","last_fullsized":"2023-08-25T09:42:43.264083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264112+0000","last_change":"2023-08-25T09:42:43.264112+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264112+0000","last_undegraded":"2023-08-25T09:42:43.264112+0000","last_fullsized":"2023-08-25T09:42:43.264112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263584+0000","last_change":"2023-08-25T09:42:43.263584+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263584+0000","last_undegraded":"2023-08-25T09:42:43.263584+0000","last_fullsized":"2023-08-25T09:42:43.263584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262805+0000","last_change":"2023-08-25T09:42:43.262805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262805+0000","last_undegraded":"2023-08-25T09:42:43.262805+0000","last_fullsized":"2023-08-25T09:42:43.262805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261226+0000","last_change":"2023-08-25T09:42:43.261226+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261226+0000","last_undegraded":"2023-08-25T09:42:43.261226+0000","last_fullsized":"2023-08-25T09:42:43.261226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265721+0000","last_change":"2023-08-25T09:42:43.265721+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265721+0000","last_undegraded":"2023-08-25T09:42:43.265721+0000","last_fullsized":"2023-08-25T09:42:43.265721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263420+0000","last_change":"2023-08-25T09:42:43.263420+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263420+0000","last_undegraded":"2023-08-25T09:42:43.263420+0000","last_fullsized":"2023-08-25T09:42:43.263420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258833+0000","last_change":"2023-08-25T09:42:43.258833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258833+0000","last_undegraded":"2023-08-25T09:42:43.258833+0000","last_fullsized":"2023-08-25T09:42:43.258833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265206+0000","last_change":"2023-08-25T09:42:43.265206+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265206+0000","last_undegraded":"2023-08-25T09:42:43.265206+0000","last_fullsized":"2023-08-25T09:42:43.265206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262857+0000","last_change":"2023-08-25T09:42:43.262857+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262857+0000","last_undegraded":"2023-08-25T09:42:43.262857+0000","last_fullsized":"2023-08-25T09:42:43.262857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263805+0000","last_change":"2023-08-25T09:42:43.263805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263805+0000","last_undegraded":"2023-08-25T09:42:43.263805+0000","last_fullsized":"2023-08-25T09:42:43.263805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262743+0000","last_change":"2023-08-25T09:42:43.262743+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262743+0000","last_undegraded":"2023-08-25T09:42:43.262743+0000","last_fullsized":"2023-08-25T09:42:43.262743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264893+0000","last_change":"2023-08-25T09:42:43.264893+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264893+0000","last_undegraded":"2023-08-25T09:42:43.264893+0000","last_fullsized":"2023-08-25T09:42:43.264893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263506+0000","last_change":"2023-08-25T09:42:43.263506+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263506+0000","last_undegraded":"2023-08-25T09:42:43.263506+0000","last_fullsized":"2023-08-25T09:42:43.263506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.266155+0000","last_change":"2023-08-25T09:42:43.266155+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.266155+0000","last_undegraded":"2023-08-25T09:42:43.266155+0000","last_fullsized":"2023-08-25T09:42:43.266155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262663+0000","last_change":"2023-08-25T09:42:43.262663+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262663+0000","last_undegraded":"2023-08-25T09:42:43.262663+0000","last_fullsized":"2023-08-25T09:42:43.262663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263511+0000","last_change":"2023-08-25T09:42:43.263511+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263511+0000","last_undegraded":"2023-08-25T09:42:43.263511+0000","last_fullsized":"2023-08-25T09:42:43.263511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261258+0000","last_change":"2023-08-25T09:42:43.261258+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261258+0000","last_undegraded":"2023-08-25T09:42:43.261258+0000","last_fullsized":"2023-08-25T09:42:43.261258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265686+0000","last_change":"2023-08-25T09:42:43.265686+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265686+0000","last_undegraded":"2023-08-25T09:42:43.265686+0000","last_fullsized":"2023-08-25T09:42:43.265686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275831+0000","last_change":"2023-08-25T09:42:43.274652+0000","last_active":"2023-08-25T09:42:43.275831+0000","last_peered":"2023-08-25T09:42:43.275831+0000","last_clean":"2023-08-25T09:42:43.275831+0000","last_became_active":"2023-08-25T09:42:43.274360+0000","last_became_peered":"2023-08-25T09:42:43.274360+0000","last_unstale":"2023-08-25T09:42:43.275831+0000","last_undegraded":"2023-08-25T09:42:43.275831+0000","last_fullsized":"2023-08-25T09:42:43.275831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:10.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260708+0000","last_change":"2023-08-25T09:42:43.260708+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260708+0000","last_undegraded":"2023-08-25T09:42:43.260708+0000","last_fullsized":"2023-08-25T09:42:43.260708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274478+0000","last_change":"2023-08-25T09:42:43.269611+0000","last_active":"2023-08-25T09:42:43.274478+0000","last_peered":"2023-08-25T09:42:43.274478+0000","last_clean":"2023-08-25T09:42:43.274478+0000","last_became_active":"2023-08-25T09:42:43.269334+0000","last_became_peered":"2023-08-25T09:42:43.269334+0000","last_unstale":"2023-08-25T09:42:43.274478+0000","last_undegraded":"2023-08-25T09:42:43.274478+0000","last_fullsized":"2023-08-25T09:42:43.274478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:57:42.803780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259397+0000","last_change":"2023-08-25T09:42:43.259397+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259397+0000","last_undegraded":"2023-08-25T09:42:43.259397+0000","last_fullsized":"2023-08-25T09:42:43.259397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274336+0000","last_change":"2023-08-25T09:42:43.270208+0000","last_active":"2023-08-25T09:42:43.274336+0000","last_peered":"2023-08-25T09:42:43.274336+0000","last_clean":"2023-08-25T09:42:43.274336+0000","last_became_active":"2023-08-25T09:42:43.269906+0000","last_became_peered":"2023-08-25T09:42:43.269906+0000","last_unstale":"2023-08-25T09:42:43.274336+0000","last_undegraded":"2023-08-25T09:42:43.274336+0000","last_fullsized":"2023-08-25T09:42:43.274336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:33.970812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261188+0000","last_change":"2023-08-25T09:42:43.261188+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261188+0000","last_undegraded":"2023-08-25T09:42:43.261188+0000","last_fullsized":"2023-08-25T09:42:43.261188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273929+0000","last_change":"2023-08-25T09:42:43.269894+0000","last_active":"2023-08-25T09:42:43.273929+0000","last_peered":"2023-08-25T09:42:43.273929+0000","last_clean":"2023-08-25T09:42:43.273929+0000","last_became_active":"2023-08-25T09:42:43.269588+0000","last_became_peered":"2023-08-25T09:42:43.269588+0000","last_unstale":"2023-08-25T09:42:43.273929+0000","last_undegraded":"2023-08-25T09:42:43.273929+0000","last_fullsized":"2023-08-25T09:42:43.273929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:23.583856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261390+0000","last_change":"2023-08-25T09:42:43.261390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261390+0000","last_undegraded":"2023-08-25T09:42:43.261390+0000","last_fullsized":"2023-08-25T09:42:43.261390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276184+0000","last_change":"2023-08-25T09:42:43.274532+0000","last_active":"2023-08-25T09:42:43.276184+0000","last_peered":"2023-08-25T09:42:43.276184+0000","last_clean":"2023-08-25T09:42:43.276184+0000","last_became_active":"2023-08-25T09:42:43.274259+0000","last_became_peered":"2023-08-25T09:42:43.274259+0000","last_unstale":"2023-08-25T09:42:43.276184+0000","last_undegraded":"2023-08-25T09:42:43.276184+0000","last_fullsized":"2023-08-25T09:42:43.276184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263486+0000","last_change":"2023-08-25T09:42:43.263486+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263486+0000","last_undegraded":"2023-08-25T09:42:43.263486+0000","last_fullsized":"2023-08-25T09:42:43.263486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272496+0000","last_change":"2023-08-25T09:42:43.271395+0000","last_active":"2023-08-25T09:42:43.272496+0000","last_peered":"2023-08-25T09:42:43.272496+0000","last_clean":"2023-08-25T09:42:43.272496+0000","last_became_active":"2023-08-25T09:42:43.271122+0000","last_became_peered":"2023-08-25T09:42:43.271122+0000","last_unstale":"2023-08-25T09:42:43.272496+0000","last_undegraded":"2023-08-25T09:42:43.272496+0000","last_fullsized":"2023-08-25T09:42:43.272496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:19.767009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259595+0000","last_change":"2023-08-25T09:42:43.259595+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259595+0000","last_undegraded":"2023-08-25T09:42:43.259595+0000","last_fullsized":"2023-08-25T09:42:43.259595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277824+0000","last_change":"2023-08-25T09:42:43.275402+0000","last_active":"2023-08-25T09:42:43.277824+0000","last_peered":"2023-08-25T09:42:43.277824+0000","last_clean":"2023-08-25T09:42:43.277824+0000","last_became_active":"2023-08-25T09:42:43.275116+0000","last_became_peered":"2023-08-25T09:42:43.275116+0000","last_unstale":"2023-08-25T09:42:43.277824+0000","last_undegraded":"2023-08-25T09:42:43.277824+0000","last_fullsized":"2023-08-25T09:42:43.277824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264298+0000","last_change":"2023-08-25T09:42:43.264298+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264298+0000","last_undegraded":"2023-08-25T09:42:43.264298+0000","last_fullsized":"2023-08-25T09:42:43.264298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272105+0000","last_change":"2023-08-25T09:42:43.269075+0000","last_active":"2023-08-25T09:42:43.272105+0000","last_peered":"2023-08-25T09:42:43.272105+0000","last_clean":"2023-08-25T09:42:43.272105+0000","last_became_active":"2023-08-25T09:42:43.268787+0000","last_became_peered":"2023-08-25T09:42:43.268787+0000","last_unstale":"2023-08-25T09:42:43.272105+0000","last_undegraded":"2023-08-25T09:42:43.272105+0000","last_fullsized":"2023-08-25T09:42:43.272105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:05.324298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263139+0000","last_change":"2023-08-25T09:42:43.263139+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263139+0000","last_undegraded":"2023-08-25T09:42:43.263139+0000","last_fullsized":"2023-08-25T09:42:43.263139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269087+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269087+0000","last_peered":"2023-08-25T09:42:43.269087+0000","last_clean":"2023-08-25T09:42:43.269087+0000","last_became_active":"2023-08-25T09:42:43.265064+0000","last_became_peered":"2023-08-25T09:42:43.265064+0000","last_unstale":"2023-08-25T09:42:43.269087+0000","last_undegraded":"2023-08-25T09:42:43.269087+0000","last_fullsized":"2023-08-25T09:42:43.269087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:30:21.363562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262964+0000","last_change":"2023-08-25T09:42:43.262964+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262964+0000","last_undegraded":"2023-08-25T09:42:43.262964+0000","last_fullsized":"2023-08-25T09:42:43.262964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277387+0000","last_change":"2023-08-25T09:42:43.276586+0000","last_active":"2023-08-25T09:42:43.277387+0000","last_peered":"2023-08-25T09:42:43.277387+0000","last_clean":"2023-08-25T09:42:43.277387+0000","last_became_active":"2023-08-25T09:42:43.276311+0000","last_became_peered":"2023-08-25T09:42:43.276311+0000","last_unstale":"2023-08-25T09:42:43.277387+0000","last_undegraded":"2023-08-25T09:42:43.277387+0000","last_fullsized":"2023-08-25T09:42:43.277387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:17:09.330315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263305+0000","last_change":"2023-08-25T09:42:43.263305+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263305+0000","last_undegraded":"2023-08-25T09:42:43.263305+0000","last_fullsized":"2023-08-25T09:42:43.263305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276924+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.276924+0000","last_peered":"2023-08-25T09:42:43.276924+0000","last_clean":"2023-08-25T09:42:43.276924+0000","last_became_active":"2023-08-25T09:42:43.275295+0000","last_became_peered":"2023-08-25T09:42:43.275295+0000","last_unstale":"2023-08-25T09:42:43.276924+0000","last_undegraded":"2023-08-25T09:42:43.276924+0000","last_fullsized":"2023-08-25T09:42:43.276924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:37.726279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258959+0000","last_change":"2023-08-25T09:42:43.258959+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258959+0000","last_undegraded":"2023-08-25T09:42:43.258959+0000","last_fullsized":"2023-08-25T09:42:43.258959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271742+0000","last_change":"2023-08-25T09:42:43.268508+0000","last_active":"2023-08-25T09:42:43.271742+0000","last_peered":"2023-08-25T09:42:43.271742+0000","last_clean":"2023-08-25T09:42:43.271742+0000","last_became_active":"2023-08-25T09:42:43.268143+0000","last_became_peered":"2023-08-25T09:42:43.268143+0000","last_unstale":"2023-08-25T09:42:43.271742+0000","last_undegraded":"2023-08-25T09:42:43.271742+0000","last_fullsized":"2023-08-25T09:42:43.271742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:38:14.600448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259876+0000","last_change":"2023-08-25T09:42:43.259876+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259876+0000","last_undegraded":"2023-08-25T09:42:43.259876+0000","last_fullsized":"2023-08-25T09:42:43.259876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271668+0000","last_change":"2023-08-25T09:42:43.267210+0000","last_active":"2023-08-25T09:42:43.271668+0000","last_peered":"2023-08-25T09:42:43.271668+0000","last_clean":"2023-08-25T09:42:43.271668+0000","last_became_active":"2023-08-25T09:42:43.266940+0000","last_became_peered":"2023-08-25T09:42:43.266940+0000","last_unstale":"2023-08-25T09:42:43.271668+0000","last_undegraded":"2023-08-25T09:42:43.271668+0000","last_fullsized":"2023-08-25T09:42:43.271668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261573+0000","last_change":"2023-08-25T09:42:43.261573+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261573+0000","last_undegraded":"2023-08-25T09:42:43.261573+0000","last_fullsized":"2023-08-25T09:42:43.261573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278080+0000","last_change":"2023-08-25T09:42:43.276967+0000","last_active":"2023-08-25T09:42:43.278080+0000","last_peered":"2023-08-25T09:42:43.278080+0000","last_clean":"2023-08-25T09:42:43.278080+0000","last_became_active":"2023-08-25T09:42:43.276646+0000","last_became_peered":"2023-08-25T09:42:43.276646+0000","last_unstale":"2023-08-25T09:42:43.278080+0000","last_undegraded":"2023-08-25T09:42:43.278080+0000","last_fullsized":"2023-08-25T09:42:43.278080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262991+0000","last_change":"2023-08-25T09:42:43.262991+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262991+0000","last_undegraded":"2023-08-25T09:42:43.262991+0000","last_fullsized":"2023-08-25T09:42:43.262991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275811+0000","last_change":"2023-08-25T09:42:43.274167+0000","last_active":"2023-08-25T09:42:43.275811+0000","last_peered":"2023-08-25T09:42:43.275811+0000","last_clean":"2023-08-25T09:42:43.275811+0000","last_became_active":"2023-08-25T09:42:43.273457+0000","last_became_peered":"2023-08-25T09:42:43.273457+0000","last_unstale":"2023-08-25T09:42:43.275811+0000","last_undegraded":"2023-08-25T09:42:43.275811+0000","last_fullsized":"2023-08-25T09:42:43.275811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:49.533731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263833+0000","last_change":"2023-08-25T09:42:43.263833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263833+0000","last_undegraded":"2023-08-25T09:42:43.263833+0000","last_fullsized":"2023-08-25T09:42:43.263833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276310+0000","last_change":"2023-08-25T09:42:43.273820+0000","last_active":"2023-08-25T09:42:43.276310+0000","last_peered":"2023-08-25T09:42:43.276310+0000","last_clean":"2023-08-25T09:42:43.276310+0000","last_became_active":"2023-08-25T09:42:43.273362+0000","last_became_peered":"2023-08-25T09:42:43.273362+0000","last_unstale":"2023-08-25T09:42:43.276310+0000","last_undegraded":"2023-08-25T09:42:43.276310+0000","last_fullsized":"2023-08-25T09:42:43.276310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:30:11.556739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264574+0000","last_change":"2023-08-25T09:42:43.264574+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264574+0000","last_undegraded":"2023-08-25T09:42:43.264574+0000","last_fullsized":"2023-08-25T09:42:43.264574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277358+0000","last_change":"2023-08-25T09:42:43.276386+0000","last_active":"2023-08-25T09:42:43.277358+0000","last_peered":"2023-08-25T09:42:43.277358+0000","last_clean":"2023-08-25T09:42:43.277358+0000","last_became_active":"2023-08-25T09:42:43.276029+0000","last_became_peered":"2023-08-25T09:42:43.276029+0000","last_unstale":"2023-08-25T09:42:43.277358+0000","last_undegraded":"2023-08-25T09:42:43.277358+0000","last_fullsized":"2023-08-25T09:42:43.277358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:10.071794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262312+0000","last_change":"2023-08-25T09:42:43.262312+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262312+0000","last_undegraded":"2023-08-25T09:42:43.262312+0000","last_fullsized":"2023-08-25T09:42:43.262312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275617+0000","last_change":"2023-08-25T09:42:43.273234+0000","last_active":"2023-08-25T09:42:43.275617+0000","last_peered":"2023-08-25T09:42:43.275617+0000","last_clean":"2023-08-25T09:42:43.275617+0000","last_became_active":"2023-08-25T09:42:43.272846+0000","last_became_peered":"2023-08-25T09:42:43.272846+0000","last_unstale":"2023-08-25T09:42:43.275617+0000","last_undegraded":"2023-08-25T09:42:43.275617+0000","last_fullsized":"2023-08-25T09:42:43.275617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:22:28.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259960+0000","last_change":"2023-08-25T09:42:43.259960+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259960+0000","last_undegraded":"2023-08-25T09:42:43.259960+0000","last_fullsized":"2023-08-25T09:42:43.259960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274963+0000","last_change":"2023-08-25T09:42:43.271438+0000","last_active":"2023-08-25T09:42:43.274963+0000","last_peered":"2023-08-25T09:42:43.274963+0000","last_clean":"2023-08-25T09:42:43.274963+0000","last_became_active":"2023-08-25T09:42:43.271184+0000","last_became_peered":"2023-08-25T09:42:43.271184+0000","last_unstale":"2023-08-25T09:42:43.274963+0000","last_undegraded":"2023-08-25T09:42:43.274963+0000","last_fullsized":"2023-08-25T09:42:43.274963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:48.671798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260382+0000","last_change":"2023-08-25T09:42:43.260382+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260382+0000","last_undegraded":"2023-08-25T09:42:43.260382+0000","last_fullsized":"2023-08-25T09:42:43.260382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274356+0000","last_change":"2023-08-25T09:42:43.270977+0000","last_active":"2023-08-25T09:42:43.274356+0000","last_peered":"2023-08-25T09:42:43.274356+0000","last_clean":"2023-08-25T09:42:43.274356+0000","last_became_active":"2023-08-25T09:42:43.270702+0000","last_became_peered":"2023-08-25T09:42:43.270702+0000","last_unstale":"2023-08-25T09:42:43.274356+0000","last_undegraded":"2023-08-25T09:42:43.274356+0000","last_fullsized":"2023-08-25T09:42:43.274356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:21.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262444+0000","last_change":"2023-08-25T09:42:43.262444+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262444+0000","last_undegraded":"2023-08-25T09:42:43.262444+0000","last_fullsized":"2023-08-25T09:42:43.262444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274363+0000","last_change":"2023-08-25T09:42:43.268849+0000","last_active":"2023-08-25T09:42:43.274363+0000","last_peered":"2023-08-25T09:42:43.274363+0000","last_clean":"2023-08-25T09:42:43.274363+0000","last_became_active":"2023-08-25T09:42:43.268561+0000","last_became_peered":"2023-08-25T09:42:43.268561+0000","last_unstale":"2023-08-25T09:42:43.274363+0000","last_undegraded":"2023-08-25T09:42:43.274363+0000","last_fullsized":"2023-08-25T09:42:43.274363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:35:49.609217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259747+0000","last_change":"2023-08-25T09:42:43.259747+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259747+0000","last_undegraded":"2023-08-25T09:42:43.259747+0000","last_fullsized":"2023-08-25T09:42:43.259747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274213+0000","last_change":"2023-08-25T09:42:43.267133+0000","last_active":"2023-08-25T09:42:43.274213+0000","last_peered":"2023-08-25T09:42:43.274213+0000","last_clean":"2023-08-25T09:42:43.274213+0000","last_became_active":"2023-08-25T09:42:43.266868+0000","last_became_peered":"2023-08-25T09:42:43.266868+0000","last_unstale":"2023-08-25T09:42:43.274213+0000","last_undegraded":"2023-08-25T09:42:43.274213+0000","last_fullsized":"2023-08-25T09:42:43.274213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:04.490031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261974+0000","last_change":"2023-08-25T09:42:43.261974+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261974+0000","last_undegraded":"2023-08-25T09:42:43.261974+0000","last_fullsized":"2023-08-25T09:42:43.261974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272464+0000","last_change":"2023-08-25T09:42:43.270692+0000","last_active":"2023-08-25T09:42:43.272464+0000","last_peered":"2023-08-25T09:42:43.272464+0000","last_clean":"2023-08-25T09:42:43.272464+0000","last_became_active":"2023-08-25T09:42:43.270431+0000","last_became_peered":"2023-08-25T09:42:43.270431+0000","last_unstale":"2023-08-25T09:42:43.272464+0000","last_undegraded":"2023-08-25T09:42:43.272464+0000","last_fullsized":"2023-08-25T09:42:43.272464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259665+0000","last_change":"2023-08-25T09:42:43.259665+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259665+0000","last_undegraded":"2023-08-25T09:42:43.259665+0000","last_fullsized":"2023-08-25T09:42:43.259665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274915+0000","last_change":"2023-08-25T09:42:43.270252+0000","last_active":"2023-08-25T09:42:43.274915+0000","last_peered":"2023-08-25T09:42:43.274915+0000","last_clean":"2023-08-25T09:42:43.274915+0000","last_became_active":"2023-08-25T09:42:43.269931+0000","last_became_peered":"2023-08-25T09:42:43.269931+0000","last_unstale":"2023-08-25T09:42:43.274915+0000","last_undegraded":"2023-08-25T09:42:43.274915+0000","last_fullsized":"2023-08-25T09:42:43.274915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:39:53.965422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262501+0000","last_change":"2023-08-25T09:42:43.262501+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262501+0000","last_undegraded":"2023-08-25T09:42:43.262501+0000","last_fullsized":"2023-08-25T09:42:43.262501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276362+0000","last_change":"2023-08-25T09:42:43.275120+0000","last_active":"2023-08-25T09:42:43.276362+0000","last_peered":"2023-08-25T09:42:43.276362+0000","last_clean":"2023-08-25T09:42:43.276362+0000","last_became_active":"2023-08-25T09:42:43.274864+0000","last_became_peered":"2023-08-25T09:42:43.274864+0000","last_unstale":"2023-08-25T09:42:43.276362+0000","last_undegraded":"2023-08-25T09:42:43.276362+0000","last_fullsized":"2023-08-25T09:42:43.276362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:38.615225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266390+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:43.266390+0000","last_peered":"2023-08-25T09:42:43.266390+0000","last_clean":"2023-08-25T09:42:43.266390+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:43.266390+0000","last_undegraded":"2023-08-25T09:42:43.266390+0000","last_fullsized":"2023-08-25T09:42:43.266390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:21:35.220456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271808+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:43.271808+0000","last_peered":"2023-08-25T09:42:43.271808+0000","last_clean":"2023-08-25T09:42:43.271808+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:43.271808+0000","last_undegraded":"2023-08-25T09:42:43.271808+0000","last_fullsized":"2023-08-25T09:42:43.271808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:50:11.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261413+0000","last_change":"2023-08-25T09:42:43.261413+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261413+0000","last_undegraded":"2023-08-25T09:42:43.261413+0000","last_fullsized":"2023-08-25T09:42:43.261413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277049+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.277049+0000","last_peered":"2023-08-25T09:42:43.277049+0000","last_clean":"2023-08-25T09:42:43.277049+0000","last_became_active":"2023-08-25T09:42:43.275237+0000","last_became_peered":"2023-08-25T09:42:43.275237+0000","last_unstale":"2023-08-25T09:42:43.277049+0000","last_undegraded":"2023-08-25T09:42:43.277049+0000","last_fullsized":"2023-08-25T09:42:43.277049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:49.486016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266259+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:43.266259+0000","last_peered":"2023-08-25T09:42:43.266259+0000","last_clean":"2023-08-25T09:42:43.266259+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:43.266259+0000","last_undegraded":"2023-08-25T09:42:43.266259+0000","last_fullsized":"2023-08-25T09:42:43.266259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:04:36.548473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262490+0000","last_change":"2023-08-25T09:42:43.262490+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262490+0000","last_undegraded":"2023-08-25T09:42:43.262490+0000","last_fullsized":"2023-08-25T09:42:43.262490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278134+0000","last_change":"2023-08-25T09:42:43.276569+0000","last_active":"2023-08-25T09:42:43.278134+0000","last_peered":"2023-08-25T09:42:43.278134+0000","last_clean":"2023-08-25T09:42:43.278134+0000","last_became_active":"2023-08-25T09:42:43.276306+0000","last_became_peered":"2023-08-25T09:42:43.276306+0000","last_unstale":"2023-08-25T09:42:43.278134+0000","last_undegraded":"2023-08-25T09:42:43.278134+0000","last_fullsized":"2023-08-25T09:42:43.278134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:12:20.185119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.259490+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:43.259490+0000","last_peered":"2023-08-25T09:42:43.259490+0000","last_clean":"2023-08-25T09:42:43.259490+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:43.259490+0000","last_undegraded":"2023-08-25T09:42:43.259490+0000","last_fullsized":"2023-08-25T09:42:43.259490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:19.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262174+0000","last_change":"2023-08-25T09:42:43.262174+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262174+0000","last_undegraded":"2023-08-25T09:42:43.262174+0000","last_fullsized":"2023-08-25T09:42:43.262174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269613+0000","last_change":"2023-08-25T09:42:43.267196+0000","last_active":"2023-08-25T09:42:43.269613+0000","last_peered":"2023-08-25T09:42:43.269613+0000","last_clean":"2023-08-25T09:42:43.269613+0000","last_became_active":"2023-08-25T09:42:43.266945+0000","last_became_peered":"2023-08-25T09:42:43.266945+0000","last_unstale":"2023-08-25T09:42:43.269613+0000","last_undegraded":"2023-08-25T09:42:43.269613+0000","last_fullsized":"2023-08-25T09:42:43.269613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:13:03.220760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271657+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:43.271657+0000","last_peered":"2023-08-25T09:42:43.271657+0000","last_clean":"2023-08-25T09:42:43.271657+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:43.271657+0000","last_undegraded":"2023-08-25T09:42:43.271657+0000","last_fullsized":"2023-08-25T09:42:43.271657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:01.957756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259368+0000","last_change":"2023-08-25T09:42:43.259368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259368+0000","last_undegraded":"2023-08-25T09:42:43.259368+0000","last_fullsized":"2023-08-25T09:42:43.259368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274716+0000","last_change":"2023-08-25T09:42:43.270865+0000","last_active":"2023-08-25T09:42:43.274716+0000","last_peered":"2023-08-25T09:42:43.274716+0000","last_clean":"2023-08-25T09:42:43.274716+0000","last_became_active":"2023-08-25T09:42:43.270528+0000","last_became_peered":"2023-08-25T09:42:43.270528+0000","last_unstale":"2023-08-25T09:42:43.274716+0000","last_undegraded":"2023-08-25T09:42:43.274716+0000","last_fullsized":"2023-08-25T09:42:43.274716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:02.604480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.261656+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:43.261656+0000","last_peered":"2023-08-25T09:42:43.261656+0000","last_clean":"2023-08-25T09:42:43.261656+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:43.261656+0000","last_undegraded":"2023-08-25T09:42:43.261656+0000","last_fullsized":"2023-08-25T09:42:43.261656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:23.036411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259879+0000","last_change":"2023-08-25T09:42:43.259879+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259879+0000","last_undegraded":"2023-08-25T09:42:43.259879+0000","last_fullsized":"2023-08-25T09:42:43.259879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272362+0000","last_change":"2023-08-25T09:42:43.270587+0000","last_active":"2023-08-25T09:42:43.272362+0000","last_peered":"2023-08-25T09:42:43.272362+0000","last_clean":"2023-08-25T09:42:43.272362+0000","last_became_active":"2023-08-25T09:42:43.270215+0000","last_became_peered":"2023-08-25T09:42:43.270215+0000","last_unstale":"2023-08-25T09:42:43.272362+0000","last_undegraded":"2023-08-25T09:42:43.272362+0000","last_fullsized":"2023-08-25T09:42:43.272362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:20.358964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266898+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:43.266898+0000","last_peered":"2023-08-25T09:42:43.266898+0000","last_clean":"2023-08-25T09:42:43.266898+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:43.266898+0000","last_undegraded":"2023-08-25T09:42:43.266898+0000","last_fullsized":"2023-08-25T09:42:43.266898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.288915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260072+0000","last_change":"2023-08-25T09:42:43.260072+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260072+0000","last_undegraded":"2023-08-25T09:42:43.260072+0000","last_fullsized":"2023-08-25T09:42:43.260072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273966+0000","last_change":"2023-08-25T09:42:43.269888+0000","last_active":"2023-08-25T09:42:43.273966+0000","last_peered":"2023-08-25T09:42:43.273966+0000","last_clean":"2023-08-25T09:42:43.273966+0000","last_became_active":"2023-08-25T09:42:43.269578+0000","last_became_peered":"2023-08-25T09:42:43.269578+0000","last_unstale":"2023-08-25T09:42:43.273966+0000","last_undegraded":"2023-08-25T09:42:43.273966+0000","last_fullsized":"2023-08-25T09:42:43.273966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.262969+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:43.262969+0000","last_peered":"2023-08-25T09:42:43.262969+0000","last_clean":"2023-08-25T09:42:43.262969+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:43.262969+0000","last_undegraded":"2023-08-25T09:42:43.262969+0000","last_fullsized":"2023-08-25T09:42:43.262969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:02.450633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264885+0000","last_change":"2023-08-25T09:42:43.264885+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264885+0000","last_undegraded":"2023-08-25T09:42:43.264885+0000","last_fullsized":"2023-08-25T09:42:43.264885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269004+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269004+0000","last_peered":"2023-08-25T09:42:43.269004+0000","last_clean":"2023-08-25T09:42:43.269004+0000","last_became_active":"2023-08-25T09:42:43.265091+0000","last_became_peered":"2023-08-25T09:42:43.265091+0000","last_unstale":"2023-08-25T09:42:43.269004+0000","last_undegraded":"2023-08-25T09:42:43.269004+0000","last_fullsized":"2023-08-25T09:42:43.269004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:44:40.542410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.264119+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:43.264119+0000","last_peered":"2023-08-25T09:42:43.264119+0000","last_clean":"2023-08-25T09:42:43.264119+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:43.264119+0000","last_undegraded":"2023-08-25T09:42:43.264119+0000","last_fullsized":"2023-08-25T09:42:43.264119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:54.470307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":726813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":733441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:47.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-08-25T09:42:47.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261734+0000', 'last_change': '2023-08-25T09:42:43.261734+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261734+0000', 'last_undegraded': '2023-08-25T09:42:43.261734+0000', 'last_fullsized': '2023-08-25T09:42:43.261734+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-08-25T09:42:47.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263965+0000', 'last_change': '2023-08-25T09:42:43.263965+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263965+0000', 'last_undegraded': '2023-08-25T09:42:43.263965+0000', 'last_fullsized': '2023-08-25T09:42:43.263965+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-08-25T09:42:47.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.260230+0000', 'last_change': '2023-08-25T09:42:43.260230+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.260230+0000', 'last_undegraded': '2023-08-25T09:42:43.260230+0000', 'last_fullsized': '2023-08-25T09:42:43.260230+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-08-25T09:42:47.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263677+0000', 'last_change': '2023-08-25T09:42:43.263677+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263677+0000', 'last_undegraded': '2023-08-25T09:42:43.263677+0000', 'last_fullsized': '2023-08-25T09:42:43.263677+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-25T09:42:47.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-08-25T09:42:47.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262321+0000', 'last_change': '2023-08-25T09:42:43.262321+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262321+0000', 'last_undegraded': '2023-08-25T09:42:43.262321+0000', 'last_fullsized': '2023-08-25T09:42:43.262321+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-25T09:42:47.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-08-25T09:42:47.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261944+0000', 'last_change': '2023-08-25T09:42:43.261944+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261944+0000', 'last_undegraded': '2023-08-25T09:42:43.261944+0000', 'last_fullsized': '2023-08-25T09:42:43.261944+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-25T09:42:47.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-08-25T09:42:47.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264994+0000', 'last_change': '2023-08-25T09:42:43.264994+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264994+0000', 'last_undegraded': '2023-08-25T09:42:43.264994+0000', 'last_fullsized': '2023-08-25T09:42:43.264994+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-08-25T09:42:47.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262073+0000', 'last_change': '2023-08-25T09:42:43.262073+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262073+0000', 'last_undegraded': '2023-08-25T09:42:43.262073+0000', 'last_fullsized': '2023-08-25T09:42:43.262073+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-08-25T09:42:47.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259390+0000', 'last_change': '2023-08-25T09:42:43.259390+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259390+0000', 'last_undegraded': '2023-08-25T09:42:43.259390+0000', 'last_fullsized': '2023-08-25T09:42:43.259390+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-08-25T09:42:47.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263942+0000', 'last_change': '2023-08-25T09:42:43.263942+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263942+0000', 'last_undegraded': '2023-08-25T09:42:43.263942+0000', 'last_fullsized': '2023-08-25T09:42:43.263942+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-08-25T09:42:47.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263245+0000', 'last_change': '2023-08-25T09:42:43.263245+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263245+0000', 'last_undegraded': '2023-08-25T09:42:43.263245+0000', 'last_fullsized': '2023-08-25T09:42:43.263245+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-08-25T09:42:47.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.260368+0000', 'last_change': '2023-08-25T09:42:43.260368+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.260368+0000', 'last_undegraded': '2023-08-25T09:42:43.260368+0000', 'last_fullsized': '2023-08-25T09:42:43.260368+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-08-25T09:42:47.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262375+0000', 'last_change': '2023-08-25T09:42:43.262375+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262375+0000', 'last_undegraded': '2023-08-25T09:42:43.262375+0000', 'last_fullsized': '2023-08-25T09:42:43.262375+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-08-25T09:42:47.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.260475+0000', 'last_change': '2023-08-25T09:42:43.260475+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.260475+0000', 'last_undegraded': '2023-08-25T09:42:43.260475+0000', 'last_fullsized': '2023-08-25T09:42:43.260475+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-08-25T09:42:47.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264083+0000', 'last_change': '2023-08-25T09:42:43.264083+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264083+0000', 'last_undegraded': '2023-08-25T09:42:43.264083+0000', 'last_fullsized': '2023-08-25T09:42:43.264083+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-08-25T09:42:47.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264112+0000', 'last_change': '2023-08-25T09:42:43.264112+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264112+0000', 'last_undegraded': '2023-08-25T09:42:43.264112+0000', 'last_fullsized': '2023-08-25T09:42:43.264112+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-08-25T09:42:47.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263584+0000', 'last_change': '2023-08-25T09:42:43.263584+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263584+0000', 'last_undegraded': '2023-08-25T09:42:43.263584+0000', 'last_fullsized': '2023-08-25T09:42:43.263584+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-08-25T09:42:47.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262805+0000', 'last_change': '2023-08-25T09:42:43.262805+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262805+0000', 'last_undegraded': '2023-08-25T09:42:43.262805+0000', 'last_fullsized': '2023-08-25T09:42:43.262805+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T09:42:47.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-08-25T09:42:47.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261226+0000', 'last_change': '2023-08-25T09:42:43.261226+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261226+0000', 'last_undegraded': '2023-08-25T09:42:43.261226+0000', 'last_fullsized': '2023-08-25T09:42:43.261226+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-25T09:42:47.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-08-25T09:42:47.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.265721+0000', 'last_change': '2023-08-25T09:42:43.265721+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.265721+0000', 'last_undegraded': '2023-08-25T09:42:43.265721+0000', 'last_fullsized': '2023-08-25T09:42:43.265721+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T09:42:47.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-08-25T09:42:47.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263420+0000', 'last_change': '2023-08-25T09:42:43.263420+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263420+0000', 'last_undegraded': '2023-08-25T09:42:43.263420+0000', 'last_fullsized': '2023-08-25T09:42:43.263420+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-08-25T09:42:47.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.258833+0000', 'last_change': '2023-08-25T09:42:43.258833+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.258833+0000', 'last_undegraded': '2023-08-25T09:42:43.258833+0000', 'last_fullsized': '2023-08-25T09:42:43.258833+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-08-25T09:42:47.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.265206+0000', 'last_change': '2023-08-25T09:42:43.265206+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.265206+0000', 'last_undegraded': '2023-08-25T09:42:43.265206+0000', 'last_fullsized': '2023-08-25T09:42:43.265206+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-08-25T09:42:47.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262857+0000', 'last_change': '2023-08-25T09:42:43.262857+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262857+0000', 'last_undegraded': '2023-08-25T09:42:43.262857+0000', 'last_fullsized': '2023-08-25T09:42:43.262857+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-25T09:42:47.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-08-25T09:42:47.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263805+0000', 'last_change': '2023-08-25T09:42:43.263805+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263805+0000', 'last_undegraded': '2023-08-25T09:42:43.263805+0000', 'last_fullsized': '2023-08-25T09:42:43.263805+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T09:42:47.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-08-25T09:42:47.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262743+0000', 'last_change': '2023-08-25T09:42:43.262743+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262743+0000', 'last_undegraded': '2023-08-25T09:42:43.262743+0000', 'last_fullsized': '2023-08-25T09:42:43.262743+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-25T09:42:47.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-08-25T09:42:47.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264893+0000', 'last_change': '2023-08-25T09:42:43.264893+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264893+0000', 'last_undegraded': '2023-08-25T09:42:43.264893+0000', 'last_fullsized': '2023-08-25T09:42:43.264893+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T09:42:47.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-08-25T09:42:47.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263506+0000', 'last_change': '2023-08-25T09:42:43.263506+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263506+0000', 'last_undegraded': '2023-08-25T09:42:43.263506+0000', 'last_fullsized': '2023-08-25T09:42:43.263506+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-08-25T09:42:47.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.266155+0000', 'last_change': '2023-08-25T09:42:43.266155+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.266155+0000', 'last_undegraded': '2023-08-25T09:42:43.266155+0000', 'last_fullsized': '2023-08-25T09:42:43.266155+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T09:42:47.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-08-25T09:42:47.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262663+0000', 'last_change': '2023-08-25T09:42:43.262663+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262663+0000', 'last_undegraded': '2023-08-25T09:42:43.262663+0000', 'last_fullsized': '2023-08-25T09:42:43.262663+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T09:42:47.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-08-25T09:42:47.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263511+0000', 'last_change': '2023-08-25T09:42:43.263511+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263511+0000', 'last_undegraded': '2023-08-25T09:42:43.263511+0000', 'last_fullsized': '2023-08-25T09:42:43.263511+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-08-25T09:42:47.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261258+0000', 'last_change': '2023-08-25T09:42:43.261258+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261258+0000', 'last_undegraded': '2023-08-25T09:42:43.261258+0000', 'last_fullsized': '2023-08-25T09:42:43.261258+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-25T09:42:47.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-08-25T09:42:47.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.265686+0000', 'last_change': '2023-08-25T09:42:43.265686+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.265686+0000', 'last_undegraded': '2023-08-25T09:42:43.265686+0000', 'last_fullsized': '2023-08-25T09:42:43.265686+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-08-25T09:42:47.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.260708+0000', 'last_change': '2023-08-25T09:42:43.260708+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.260708+0000', 'last_undegraded': '2023-08-25T09:42:43.260708+0000', 'last_fullsized': '2023-08-25T09:42:43.260708+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-25T09:42:47.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-08-25T09:42:47.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259397+0000', 'last_change': '2023-08-25T09:42:43.259397+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259397+0000', 'last_undegraded': '2023-08-25T09:42:43.259397+0000', 'last_fullsized': '2023-08-25T09:42:43.259397+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-08-25T09:42:47.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261188+0000', 'last_change': '2023-08-25T09:42:43.261188+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261188+0000', 'last_undegraded': '2023-08-25T09:42:43.261188+0000', 'last_fullsized': '2023-08-25T09:42:43.261188+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-08-25T09:42:47.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261390+0000', 'last_change': '2023-08-25T09:42:43.261390+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261390+0000', 'last_undegraded': '2023-08-25T09:42:43.261390+0000', 'last_fullsized': '2023-08-25T09:42:43.261390+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-08-25T09:42:47.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263486+0000', 'last_change': '2023-08-25T09:42:43.263486+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263486+0000', 'last_undegraded': '2023-08-25T09:42:43.263486+0000', 'last_fullsized': '2023-08-25T09:42:43.263486+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-08-25T09:42:47.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259595+0000', 'last_change': '2023-08-25T09:42:43.259595+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259595+0000', 'last_undegraded': '2023-08-25T09:42:43.259595+0000', 'last_fullsized': '2023-08-25T09:42:43.259595+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-08-25T09:42:47.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264298+0000', 'last_change': '2023-08-25T09:42:43.264298+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264298+0000', 'last_undegraded': '2023-08-25T09:42:43.264298+0000', 'last_fullsized': '2023-08-25T09:42:43.264298+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-08-25T09:42:47.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263139+0000', 'last_change': '2023-08-25T09:42:43.263139+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263139+0000', 'last_undegraded': '2023-08-25T09:42:43.263139+0000', 'last_fullsized': '2023-08-25T09:42:43.263139+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-25T09:42:47.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-08-25T09:42:47.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262964+0000', 'last_change': '2023-08-25T09:42:43.262964+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262964+0000', 'last_undegraded': '2023-08-25T09:42:43.262964+0000', 'last_fullsized': '2023-08-25T09:42:43.262964+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-08-25T09:42:47.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263305+0000', 'last_change': '2023-08-25T09:42:43.263305+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263305+0000', 'last_undegraded': '2023-08-25T09:42:43.263305+0000', 'last_fullsized': '2023-08-25T09:42:43.263305+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-08-25T09:42:47.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.258959+0000', 'last_change': '2023-08-25T09:42:43.258959+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.258959+0000', 'last_undegraded': '2023-08-25T09:42:43.258959+0000', 'last_fullsized': '2023-08-25T09:42:43.258959+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-08-25T09:42:47.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259876+0000', 'last_change': '2023-08-25T09:42:43.259876+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259876+0000', 'last_undegraded': '2023-08-25T09:42:43.259876+0000', 'last_fullsized': '2023-08-25T09:42:43.259876+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-08-25T09:42:47.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261573+0000', 'last_change': '2023-08-25T09:42:43.261573+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261573+0000', 'last_undegraded': '2023-08-25T09:42:43.261573+0000', 'last_fullsized': '2023-08-25T09:42:43.261573+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-08-25T09:42:47.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262991+0000', 'last_change': '2023-08-25T09:42:43.262991+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262991+0000', 'last_undegraded': '2023-08-25T09:42:43.262991+0000', 'last_fullsized': '2023-08-25T09:42:43.262991+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-08-25T09:42:47.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.263833+0000', 'last_change': '2023-08-25T09:42:43.263833+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.263833+0000', 'last_undegraded': '2023-08-25T09:42:43.263833+0000', 'last_fullsized': '2023-08-25T09:42:43.263833+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-08-25T09:42:47.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264574+0000', 'last_change': '2023-08-25T09:42:43.264574+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264574+0000', 'last_undegraded': '2023-08-25T09:42:43.264574+0000', 'last_fullsized': '2023-08-25T09:42:43.264574+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-08-25T09:42:47.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262312+0000', 'last_change': '2023-08-25T09:42:43.262312+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262312+0000', 'last_undegraded': '2023-08-25T09:42:43.262312+0000', 'last_fullsized': '2023-08-25T09:42:43.262312+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-08-25T09:42:47.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259960+0000', 'last_change': '2023-08-25T09:42:43.259960+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259960+0000', 'last_undegraded': '2023-08-25T09:42:43.259960+0000', 'last_fullsized': '2023-08-25T09:42:43.259960+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-08-25T09:42:47.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.260382+0000', 'last_change': '2023-08-25T09:42:43.260382+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.260382+0000', 'last_undegraded': '2023-08-25T09:42:43.260382+0000', 'last_fullsized': '2023-08-25T09:42:43.260382+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-25T09:42:47.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-08-25T09:42:47.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262444+0000', 'last_change': '2023-08-25T09:42:43.262444+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262444+0000', 'last_undegraded': '2023-08-25T09:42:43.262444+0000', 'last_fullsized': '2023-08-25T09:42:43.262444+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-08-25T09:42:47.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259747+0000', 'last_change': '2023-08-25T09:42:43.259747+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259747+0000', 'last_undegraded': '2023-08-25T09:42:43.259747+0000', 'last_fullsized': '2023-08-25T09:42:43.259747+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-08-25T09:42:47.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261974+0000', 'last_change': '2023-08-25T09:42:43.261974+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261974+0000', 'last_undegraded': '2023-08-25T09:42:43.261974+0000', 'last_fullsized': '2023-08-25T09:42:43.261974+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-08-25T09:42:47.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259665+0000', 'last_change': '2023-08-25T09:42:43.259665+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259665+0000', 'last_undegraded': '2023-08-25T09:42:43.259665+0000', 'last_fullsized': '2023-08-25T09:42:43.259665+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-08-25T09:42:47.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262501+0000', 'last_change': '2023-08-25T09:42:43.262501+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262501+0000', 'last_undegraded': '2023-08-25T09:42:43.262501+0000', 'last_fullsized': '2023-08-25T09:42:43.262501+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-25T09:42:47.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-08-25T09:42:47.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.261413+0000', 'last_change': '2023-08-25T09:42:43.261413+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.261413+0000', 'last_undegraded': '2023-08-25T09:42:43.261413+0000', 'last_fullsized': '2023-08-25T09:42:43.261413+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-25T09:42:47.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-08-25T09:42:47.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262490+0000', 'last_change': '2023-08-25T09:42:43.262490+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262490+0000', 'last_undegraded': '2023-08-25T09:42:43.262490+0000', 'last_fullsized': '2023-08-25T09:42:43.262490+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-08-25T09:42:47.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.262174+0000', 'last_change': '2023-08-25T09:42:43.262174+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.262174+0000', 'last_undegraded': '2023-08-25T09:42:43.262174+0000', 'last_fullsized': '2023-08-25T09:42:43.262174+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-25T09:42:47.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-08-25T09:42:47.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259368+0000', 'last_change': '2023-08-25T09:42:43.259368+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259368+0000', 'last_undegraded': '2023-08-25T09:42:43.259368+0000', 'last_fullsized': '2023-08-25T09:42:43.259368+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-25T09:42:47.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-08-25T09:42:47.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.259879+0000', 'last_change': '2023-08-25T09:42:43.259879+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.259879+0000', 'last_undegraded': '2023-08-25T09:42:43.259879+0000', 'last_fullsized': '2023-08-25T09:42:43.259879+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-25T09:42:47.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-08-25T09:42:47.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.260072+0000', 'last_change': '2023-08-25T09:42:43.260072+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.260072+0000', 'last_undegraded': '2023-08-25T09:42:43.260072+0000', 'last_fullsized': '2023-08-25T09:42:43.260072+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-25T09:42:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-08-25T09:42:47.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-08-25T09:42:43.264885+0000', 'last_change': '2023-08-25T09:42:43.264885+0000', 'last_active': '2023-08-25T09:42:43.249552+0000', 'last_peered': '2023-08-25T09:42:43.249552+0000', 'last_clean': '2023-08-25T09:42:43.249552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T09:42:43.264885+0000', 'last_undegraded': '2023-08-25T09:42:43.264885+0000', 'last_fullsized': '2023-08-25T09:42:43.264885+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'last_clean_scrub_stamp': '2023-08-25T09:42:43.249552+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T09:42:47.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T09:42:48.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.040+0000 7fde2b347640 1 Processor -- start 2023-08-25T09:42:48.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.041+0000 7fde2b347640 1 -- start start 2023-08-25T09:42:48.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.041+0000 7fde2b347640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 0x7fde240b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.041+0000 7fde2b347640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fde240b9b60 0x7fde240bae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.041+0000 7fde2b347640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde240ba990 con 0x7fde240b8e60 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.041+0000 7fde2b347640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde240b9ff0 con 0x7fde240b9b60 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.041+0000 7fde2b347640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde240ba2d0 con 0x7fde240b5780 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde290e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 0x7fde240b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde288e2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fde240b9b60 0x7fde240bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde288e2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fde240b9b60 0x7fde240bae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:46530/0 (socket says 172.21.15.89:46530) 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde288e2640 1 -- 172.21.15.89:0/3466079866 learned_addr learned my addr 172.21.15.89:0/3466079866 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde290e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 0x7fde240b71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43702/0 (socket says 172.21.15.89:43702) 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde298e4640 1 --1- 172.21.15.89:0/3466079866 >> v1:172.21.15.121:6789/0 conn(0x7fde240b8e60 0x7fde240708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.89:39810/0 (socket says 172.21.15.89:39810) 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde290e3640 1 -- 172.21.15.89:0/3466079866 >> v2:172.21.15.121:3300/0 conn(0x7fde240b9b60 msgr2=0x7fde240bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde290e3640 1 --2- 172.21.15.89:0/3466079866 >> v2:172.21.15.121:3300/0 conn(0x7fde240b9b60 0x7fde240bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde290e3640 1 -- 172.21.15.89:0/3466079866 >> v1:172.21.15.121:6789/0 conn(0x7fde240b8e60 legacy=0x7fde240708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.042+0000 7fde290e3640 1 -- 172.21.15.89:0/3466079866 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240b5b60 con 0x7fde240b5780 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde290e3640 1 --2- 172.21.15.89:0/3466079866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 0x7fde240b71f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097a0 tx=0x7fde1c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c597231df4abdbd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde1bfff640 1 -- 172.21.15.89:0/3466079866 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c031830 con 0x7fde240b5780 2023-08-25T09:42:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde1bfff640 1 -- 172.21.15.89:0/3466079866 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c031990 con 0x7fde240b5780 2023-08-25T09:42:48.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde1bfff640 1 -- 172.21.15.89:0/3466079866 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c031d20 con 0x7fde240b5780 2023-08-25T09:42:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 -- 172.21.15.89:0/3466079866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 msgr2=0x7fde240b71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 --2- 172.21.15.89:0/3466079866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 0x7fde240b71f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097a0 tx=0x7fde1c02b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 -- 172.21.15.89:0/3466079866 shutdown_connections 2023-08-25T09:42:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 --2- 172.21.15.89:0/3466079866 >> v2:172.21.15.121:3300/0 conn(0x7fde240b9b60 0x7fde240bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 --2- 172.21.15.89:0/3466079866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b5780 0x7fde240b71f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 -- 172.21.15.89:0/3466079866 >> 172.21.15.89:0/3466079866 conn(0x7fde2406e3f0 msgr2=0x7fde2406e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 -- 172.21.15.89:0/3466079866 shutdown_connections 2023-08-25T09:42:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.043+0000 7fde2b347640 1 -- 172.21.15.89:0/3466079866 wait complete. 2023-08-25T09:42:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.044+0000 7fde2b347640 1 Processor -- start 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.044+0000 7fde2b347640 1 -- start start 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde2b347640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde240b5780 0x7fde240b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde2b347640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b8e60 0x7fde24146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde2b347640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 0x7fde24147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde2b347640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240b4a70 con 0x7fde241496f0 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde2b347640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240a7af0 con 0x7fde240b5780 2023-08-25T09:42:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde2b347640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde24147440 con 0x7fde240b8e60 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 0x7fde24147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 0x7fde24147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35192/0 (socket says 172.21.15.89:35192) 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 -- 172.21.15.89:0/1269139335 learned_addr learned my addr 172.21.15.89:0/1269139335 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde288e2640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b8e60 0x7fde24146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde290e3640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde240b5780 0x7fde240b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 -- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b8e60 msgr2=0x7fde24146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b8e60 0x7fde24146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 -- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde240b5780 msgr2=0x7fde240b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde240b5780 0x7fde240b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde298e4640 1 -- 172.21.15.89:0/1269139335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c009400 con 0x7fde241496f0 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.045+0000 7fde290e3640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde240b5780 0x7fde240b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.046+0000 7fde298e4640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 0x7fde24147820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c730 tx=0x7fde2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.046+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000ce40 con 0x7fde241496f0 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.046+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000a5e0 con 0x7fde241496f0 2023-08-25T09:42:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.046+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde241dd640 con 0x7fde241496f0 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.046+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000a950 con 0x7fde241496f0 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.046+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde241ddbc0 con 0x7fde241496f0 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.047+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde241ddde0 con 0x7fde241496f0 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.047+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fde2000aab0 con 0x7fde241496f0 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.048+0000 7fde19ffb640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fde0806a050 0x7fde0806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.048+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde20087be0 con 0x7fde241496f0 2023-08-25T09:42:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.048+0000 7fde290e3640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fde0806a050 0x7fde0806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.048+0000 7fde290e3640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fde0806a050 0x7fde0806c510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fde1c036000 tx=0x7fde1c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:48.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.052+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fde20053380 con 0x7fde241496f0 2023-08-25T09:42:48.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.280+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fde24073bf0 con 0x7fde241496f0 2023-08-25T09:42:48.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.280+0000 7fde19ffb640 1 -- 172.21.15.89:0/1269139335 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2517 (secure 0 0 0) 0x7fde200179f0 con 0x7fde241496f0 2023-08-25T09:42:48.283 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:48.284 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1692956507,"num_in_osds":8,"osd_in_since":1692956498,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":225349632,"bytes_avail":772868763648,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":12,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5067}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-08-25T09:42:42.508436+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T09:42:48.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fde0806a050 msgr2=0x7fde0806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fde0806a050 0x7fde0806c510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fde1c036000 tx=0x7fde1c008030 comp rx=0 tx=0).stop 2023-08-25T09:42:48.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 msgr2=0x7fde24147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 0x7fde24147820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c730 tx=0x7fde2000cbf0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 shutdown_connections 2023-08-25T09:42:48.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fde0806a050 0x7fde0806c510 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde241496f0 0x7fde24147820 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde240b8e60 0x7fde24146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 --2- 172.21.15.89:0/1269139335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde240b5780 0x7fde240b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 >> 172.21.15.89:0/1269139335 conn(0x7fde2406e3f0 msgr2=0x7fde241431a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:48.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 shutdown_connections 2023-08-25T09:42:48.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.282+0000 7fde2b347640 1 -- 172.21.15.89:0/1269139335 wait complete. 2023-08-25T09:42:48.295 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T09:42:48.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:48.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 Processor -- start 2023-08-25T09:42:48.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 -- start start 2023-08-25T09:42:48.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f36b80b6ec0 0x7f36b80bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36b814ddb0 0x7f36b814e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b8145020 con 0x7f36b8144c40 2023-08-25T09:42:48.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80b9330 con 0x7f36b80b6ec0 2023-08-25T09:42:48.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.396+0000 7f36bd8bf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80b7d70 con 0x7f36b814ddb0 2023-08-25T09:42:48.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f36b80b6ec0 0x7f36b80bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f36b80b6ec0 0x7f36b80bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35206/0 (socket says 172.21.15.89:35206) 2023-08-25T09:42:48.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 -- 172.21.15.89:0/3509843533 learned_addr learned my addr 172.21.15.89:0/3509843533 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:48.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b77fe640 1 --2- 172.21.15.89:0/3509843533 >> v2:172.21.15.121:3300/0 conn(0x7f36b814ddb0 0x7f36b814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 -- 172.21.15.89:0/3509843533 >> v2:172.21.15.121:3300/0 conn(0x7f36b814ddb0 msgr2=0x7f36b814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:48.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 --2- 172.21.15.89:0/3509843533 >> v2:172.21.15.121:3300/0 conn(0x7f36b814ddb0 0x7f36b814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 -- 172.21.15.89:0/3509843533 >> v1:172.21.15.121:6789/0 conn(0x7f36b8144c40 legacy=0x7f36b80b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.397+0000 7f36b67fc640 1 -- 172.21.15.89:0/3509843533 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b80bd290 con 0x7f36b80b6ec0 2023-08-25T09:42:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36b67fc640 1 --2- 172.21.15.89:0/3509843533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80bcc70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f36b80bd730 tx=0x7f36ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce534f5645dbe6a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36b5ffb640 1 -- 172.21.15.89:0/3509843533 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac031870 con 0x7f36b80b6ec0 2023-08-25T09:42:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36b5ffb640 1 -- 172.21.15.89:0/3509843533 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0319d0 con 0x7f36b80b6ec0 2023-08-25T09:42:48.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36b5ffb640 1 -- 172.21.15.89:0/3509843533 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac031d60 con 0x7f36b80b6ec0 2023-08-25T09:42:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 -- 172.21.15.89:0/3509843533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 msgr2=0x7f36b80bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/3509843533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80bcc70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f36b80bd730 tx=0x7f36ac02b910 comp rx=0 tx=0).stop 2023-08-25T09:42:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 -- 172.21.15.89:0/3509843533 shutdown_connections 2023-08-25T09:42:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/3509843533 >> v2:172.21.15.121:3300/0 conn(0x7f36b814ddb0 0x7f36b814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/3509843533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80bcc70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 -- 172.21.15.89:0/3509843533 >> 172.21.15.89:0/3509843533 conn(0x7f36b80654f0 msgr2=0x7f36b80658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 -- 172.21.15.89:0/3509843533 shutdown_connections 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.398+0000 7f36bd8bf640 1 -- 172.21.15.89:0/3509843533 wait complete. 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.399+0000 7f36bd8bf640 1 Processor -- start 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 -- start start 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b8144c40 0x7f36b80beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36b814ddb0 0x7f36b80c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80c0c50 con 0x7f36b80b6ec0 2023-08-25T09:42:48.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80c10d0 con 0x7f36b8144c40 2023-08-25T09:42:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36bd8bf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80c0e30 con 0x7f36b814ddb0 2023-08-25T09:42:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35214/0 (socket says 172.21.15.89:35214) 2023-08-25T09:42:48.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 -- 172.21.15.89:0/156737969 learned_addr learned my addr 172.21.15.89:0/156737969 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:48.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b77fe640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36b814ddb0 0x7f36b80c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b67fc640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b8144c40 0x7f36b80beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 -- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36b814ddb0 msgr2=0x7f36b80c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36b814ddb0 0x7f36b80c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 -- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b8144c40 msgr2=0x7f36b80beab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b8144c40 0x7f36b80beab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b6ffd640 1 -- 172.21.15.89:0/156737969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0094d0 con 0x7f36b80b6ec0 2023-08-25T09:42:48.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.400+0000 7f36b67fc640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b8144c40 0x7f36b80beab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:48.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.401+0000 7f36b6ffd640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80b5890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c430 tx=0x7f36a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:48.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.401+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011790 con 0x7f36b80b6ec0 2023-08-25T09:42:48.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.401+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80118f0 con 0x7f36b80b6ec0 2023-08-25T09:42:48.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.401+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80be2b0 con 0x7f36b80b6ec0 2023-08-25T09:42:48.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.401+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011ce0 con 0x7f36b80b6ec0 2023-08-25T09:42:48.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.401+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b8142230 con 0x7f36b80b6ec0 2023-08-25T09:42:48.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.402+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b80be110 con 0x7f36b80b6ec0 2023-08-25T09:42:48.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.402+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36a801c460 con 0x7f36b80b6ec0 2023-08-25T09:42:48.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.402+0000 7f369ffff640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f36a406a050 0x7f36a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:48.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.402+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36a80884d0 con 0x7f36b80b6ec0 2023-08-25T09:42:48.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.402+0000 7f36b67fc640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f36a406a050 0x7f36a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:48.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.403+0000 7f36b67fc640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f36a406a050 0x7f36a406c510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36ac036000 tx=0x7f36ac03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:48.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.407+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f36b80be110 con 0x7f36b80b6ec0 2023-08-25T09:42:48.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.573+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36b80b8b30 con 0x7f36a406a050 2023-08-25T09:42:48.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.580+0000 7f369ffff640 1 -- 172.21.15.89:0/156737969 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281444 (secure 0 0 0) 0x7f36ac03a420 con 0x7f36a406a050 2023-08-25T09:42:48.584 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:48.585 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:48.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f36a406a050 msgr2=0x7f36a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f36a406a050 0x7f36a406c510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36ac036000 tx=0x7f36ac03c040 comp rx=0 tx=0).stop 2023-08-25T09:42:48.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 msgr2=0x7f36b80b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:48.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80b5890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c430 tx=0x7f36a800c8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 shutdown_connections 2023-08-25T09:42:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f36a406a050 0x7f36a406c510 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36b814ddb0 0x7f36b80c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b8144c40 0x7f36b80beab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 --2- 172.21.15.89:0/156737969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b80b6ec0 0x7f36b80b5890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 >> 172.21.15.89:0/156737969 conn(0x7f36b80654f0 msgr2=0x7f36b81429b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 shutdown_connections 2023-08-25T09:42:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:48.583+0000 7f36bd8bf640 1 -- 172.21.15.89:0/156737969 wait complete. 2023-08-25T09:42:48.595 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-08-25T09:42:48.509398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220068,"kb_used_data":3904,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754652,"statfs":{"total":773094113280,"available":772868763648,"internally_reserved":0,"allocated":3997696,"data_stored":2285552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001003"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261734+0000","last_change":"2023-08-25T09:42:43.261734+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261734+0000","last_undegraded":"2023-08-25T09:42:43.261734+0000","last_fullsized":"2023-08-25T09:42:43.261734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263965+0000","last_change":"2023-08-25T09:42:43.263965+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263965+0000","last_undegraded":"2023-08-25T09:42:43.263965+0000","last_fullsized":"2023-08-25T09:42:43.263965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260230+0000","last_change":"2023-08-25T09:42:43.260230+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260230+0000","last_undegraded":"2023-08-25T09:42:43.260230+0000","last_fullsized":"2023-08-25T09:42:43.260230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263677+0000","last_change":"2023-08-25T09:42:43.263677+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263677+0000","last_undegraded":"2023-08-25T09:42:43.263677+0000","last_fullsized":"2023-08-25T09:42:43.263677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262321+0000","last_change":"2023-08-25T09:42:43.262321+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262321+0000","last_undegraded":"2023-08-25T09:42:43.262321+0000","last_fullsized":"2023-08-25T09:42:43.262321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261944+0000","last_change":"2023-08-25T09:42:43.261944+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261944+0000","last_undegraded":"2023-08-25T09:42:43.261944+0000","last_fullsized":"2023-08-25T09:42:43.261944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264994+0000","last_change":"2023-08-25T09:42:43.264994+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264994+0000","last_undegraded":"2023-08-25T09:42:43.264994+0000","last_fullsized":"2023-08-25T09:42:43.264994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262073+0000","last_change":"2023-08-25T09:42:43.262073+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262073+0000","last_undegraded":"2023-08-25T09:42:43.262073+0000","last_fullsized":"2023-08-25T09:42:43.262073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259390+0000","last_change":"2023-08-25T09:42:43.259390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259390+0000","last_undegraded":"2023-08-25T09:42:43.259390+0000","last_fullsized":"2023-08-25T09:42:43.259390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263942+0000","last_change":"2023-08-25T09:42:43.263942+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263942+0000","last_undegraded":"2023-08-25T09:42:43.263942+0000","last_fullsized":"2023-08-25T09:42:43.263942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263245+0000","last_change":"2023-08-25T09:42:43.263245+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263245+0000","last_undegraded":"2023-08-25T09:42:43.263245+0000","last_fullsized":"2023-08-25T09:42:43.263245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260368+0000","last_change":"2023-08-25T09:42:43.260368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260368+0000","last_undegraded":"2023-08-25T09:42:43.260368+0000","last_fullsized":"2023-08-25T09:42:43.260368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262375+0000","last_change":"2023-08-25T09:42:43.262375+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262375+0000","last_undegraded":"2023-08-25T09:42:43.262375+0000","last_fullsized":"2023-08-25T09:42:43.262375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260475+0000","last_change":"2023-08-25T09:42:43.260475+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260475+0000","last_undegraded":"2023-08-25T09:42:43.260475+0000","last_fullsized":"2023-08-25T09:42:43.260475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264083+0000","last_change":"2023-08-25T09:42:43.264083+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264083+0000","last_undegraded":"2023-08-25T09:42:43.264083+0000","last_fullsized":"2023-08-25T09:42:43.264083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264112+0000","last_change":"2023-08-25T09:42:43.264112+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264112+0000","last_undegraded":"2023-08-25T09:42:43.264112+0000","last_fullsized":"2023-08-25T09:42:43.264112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263584+0000","last_change":"2023-08-25T09:42:43.263584+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263584+0000","last_undegraded":"2023-08-25T09:42:43.263584+0000","last_fullsized":"2023-08-25T09:42:43.263584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262805+0000","last_change":"2023-08-25T09:42:43.262805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262805+0000","last_undegraded":"2023-08-25T09:42:43.262805+0000","last_fullsized":"2023-08-25T09:42:43.262805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261226+0000","last_change":"2023-08-25T09:42:43.261226+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261226+0000","last_undegraded":"2023-08-25T09:42:43.261226+0000","last_fullsized":"2023-08-25T09:42:43.261226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265721+0000","last_change":"2023-08-25T09:42:43.265721+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265721+0000","last_undegraded":"2023-08-25T09:42:43.265721+0000","last_fullsized":"2023-08-25T09:42:43.265721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263420+0000","last_change":"2023-08-25T09:42:43.263420+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263420+0000","last_undegraded":"2023-08-25T09:42:43.263420+0000","last_fullsized":"2023-08-25T09:42:43.263420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258833+0000","last_change":"2023-08-25T09:42:43.258833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258833+0000","last_undegraded":"2023-08-25T09:42:43.258833+0000","last_fullsized":"2023-08-25T09:42:43.258833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265206+0000","last_change":"2023-08-25T09:42:43.265206+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265206+0000","last_undegraded":"2023-08-25T09:42:43.265206+0000","last_fullsized":"2023-08-25T09:42:43.265206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262857+0000","last_change":"2023-08-25T09:42:43.262857+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262857+0000","last_undegraded":"2023-08-25T09:42:43.262857+0000","last_fullsized":"2023-08-25T09:42:43.262857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263805+0000","last_change":"2023-08-25T09:42:43.263805+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263805+0000","last_undegraded":"2023-08-25T09:42:43.263805+0000","last_fullsized":"2023-08-25T09:42:43.263805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262743+0000","last_change":"2023-08-25T09:42:43.262743+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262743+0000","last_undegraded":"2023-08-25T09:42:43.262743+0000","last_fullsized":"2023-08-25T09:42:43.262743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264893+0000","last_change":"2023-08-25T09:42:43.264893+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264893+0000","last_undegraded":"2023-08-25T09:42:43.264893+0000","last_fullsized":"2023-08-25T09:42:43.264893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263506+0000","last_change":"2023-08-25T09:42:43.263506+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263506+0000","last_undegraded":"2023-08-25T09:42:43.263506+0000","last_fullsized":"2023-08-25T09:42:43.263506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.266155+0000","last_change":"2023-08-25T09:42:43.266155+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.266155+0000","last_undegraded":"2023-08-25T09:42:43.266155+0000","last_fullsized":"2023-08-25T09:42:43.266155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262663+0000","last_change":"2023-08-25T09:42:43.262663+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262663+0000","last_undegraded":"2023-08-25T09:42:43.262663+0000","last_fullsized":"2023-08-25T09:42:43.262663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263511+0000","last_change":"2023-08-25T09:42:43.263511+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263511+0000","last_undegraded":"2023-08-25T09:42:43.263511+0000","last_fullsized":"2023-08-25T09:42:43.263511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261258+0000","last_change":"2023-08-25T09:42:43.261258+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261258+0000","last_undegraded":"2023-08-25T09:42:43.261258+0000","last_fullsized":"2023-08-25T09:42:43.261258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.265686+0000","last_change":"2023-08-25T09:42:43.265686+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.265686+0000","last_undegraded":"2023-08-25T09:42:43.265686+0000","last_fullsized":"2023-08-25T09:42:43.265686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275831+0000","last_change":"2023-08-25T09:42:43.274652+0000","last_active":"2023-08-25T09:42:43.275831+0000","last_peered":"2023-08-25T09:42:43.275831+0000","last_clean":"2023-08-25T09:42:43.275831+0000","last_became_active":"2023-08-25T09:42:43.274360+0000","last_became_peered":"2023-08-25T09:42:43.274360+0000","last_unstale":"2023-08-25T09:42:43.275831+0000","last_undegraded":"2023-08-25T09:42:43.275831+0000","last_fullsized":"2023-08-25T09:42:43.275831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:10.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260708+0000","last_change":"2023-08-25T09:42:43.260708+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260708+0000","last_undegraded":"2023-08-25T09:42:43.260708+0000","last_fullsized":"2023-08-25T09:42:43.260708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274478+0000","last_change":"2023-08-25T09:42:43.269611+0000","last_active":"2023-08-25T09:42:43.274478+0000","last_peered":"2023-08-25T09:42:43.274478+0000","last_clean":"2023-08-25T09:42:43.274478+0000","last_became_active":"2023-08-25T09:42:43.269334+0000","last_became_peered":"2023-08-25T09:42:43.269334+0000","last_unstale":"2023-08-25T09:42:43.274478+0000","last_undegraded":"2023-08-25T09:42:43.274478+0000","last_fullsized":"2023-08-25T09:42:43.274478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:57:42.803780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259397+0000","last_change":"2023-08-25T09:42:43.259397+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259397+0000","last_undegraded":"2023-08-25T09:42:43.259397+0000","last_fullsized":"2023-08-25T09:42:43.259397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274336+0000","last_change":"2023-08-25T09:42:43.270208+0000","last_active":"2023-08-25T09:42:43.274336+0000","last_peered":"2023-08-25T09:42:43.274336+0000","last_clean":"2023-08-25T09:42:43.274336+0000","last_became_active":"2023-08-25T09:42:43.269906+0000","last_became_peered":"2023-08-25T09:42:43.269906+0000","last_unstale":"2023-08-25T09:42:43.274336+0000","last_undegraded":"2023-08-25T09:42:43.274336+0000","last_fullsized":"2023-08-25T09:42:43.274336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:33.970812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261188+0000","last_change":"2023-08-25T09:42:43.261188+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261188+0000","last_undegraded":"2023-08-25T09:42:43.261188+0000","last_fullsized":"2023-08-25T09:42:43.261188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273929+0000","last_change":"2023-08-25T09:42:43.269894+0000","last_active":"2023-08-25T09:42:43.273929+0000","last_peered":"2023-08-25T09:42:43.273929+0000","last_clean":"2023-08-25T09:42:43.273929+0000","last_became_active":"2023-08-25T09:42:43.269588+0000","last_became_peered":"2023-08-25T09:42:43.269588+0000","last_unstale":"2023-08-25T09:42:43.273929+0000","last_undegraded":"2023-08-25T09:42:43.273929+0000","last_fullsized":"2023-08-25T09:42:43.273929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:23.583856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261390+0000","last_change":"2023-08-25T09:42:43.261390+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261390+0000","last_undegraded":"2023-08-25T09:42:43.261390+0000","last_fullsized":"2023-08-25T09:42:43.261390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276184+0000","last_change":"2023-08-25T09:42:43.274532+0000","last_active":"2023-08-25T09:42:43.276184+0000","last_peered":"2023-08-25T09:42:43.276184+0000","last_clean":"2023-08-25T09:42:43.276184+0000","last_became_active":"2023-08-25T09:42:43.274259+0000","last_became_peered":"2023-08-25T09:42:43.274259+0000","last_unstale":"2023-08-25T09:42:43.276184+0000","last_undegraded":"2023-08-25T09:42:43.276184+0000","last_fullsized":"2023-08-25T09:42:43.276184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263486+0000","last_change":"2023-08-25T09:42:43.263486+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263486+0000","last_undegraded":"2023-08-25T09:42:43.263486+0000","last_fullsized":"2023-08-25T09:42:43.263486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272496+0000","last_change":"2023-08-25T09:42:43.271395+0000","last_active":"2023-08-25T09:42:43.272496+0000","last_peered":"2023-08-25T09:42:43.272496+0000","last_clean":"2023-08-25T09:42:43.272496+0000","last_became_active":"2023-08-25T09:42:43.271122+0000","last_became_peered":"2023-08-25T09:42:43.271122+0000","last_unstale":"2023-08-25T09:42:43.272496+0000","last_undegraded":"2023-08-25T09:42:43.272496+0000","last_fullsized":"2023-08-25T09:42:43.272496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:19.767009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259595+0000","last_change":"2023-08-25T09:42:43.259595+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259595+0000","last_undegraded":"2023-08-25T09:42:43.259595+0000","last_fullsized":"2023-08-25T09:42:43.259595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277824+0000","last_change":"2023-08-25T09:42:43.275402+0000","last_active":"2023-08-25T09:42:43.277824+0000","last_peered":"2023-08-25T09:42:43.277824+0000","last_clean":"2023-08-25T09:42:43.277824+0000","last_became_active":"2023-08-25T09:42:43.275116+0000","last_became_peered":"2023-08-25T09:42:43.275116+0000","last_unstale":"2023-08-25T09:42:43.277824+0000","last_undegraded":"2023-08-25T09:42:43.277824+0000","last_fullsized":"2023-08-25T09:42:43.277824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264298+0000","last_change":"2023-08-25T09:42:43.264298+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264298+0000","last_undegraded":"2023-08-25T09:42:43.264298+0000","last_fullsized":"2023-08-25T09:42:43.264298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272105+0000","last_change":"2023-08-25T09:42:43.269075+0000","last_active":"2023-08-25T09:42:43.272105+0000","last_peered":"2023-08-25T09:42:43.272105+0000","last_clean":"2023-08-25T09:42:43.272105+0000","last_became_active":"2023-08-25T09:42:43.268787+0000","last_became_peered":"2023-08-25T09:42:43.268787+0000","last_unstale":"2023-08-25T09:42:43.272105+0000","last_undegraded":"2023-08-25T09:42:43.272105+0000","last_fullsized":"2023-08-25T09:42:43.272105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:05.324298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263139+0000","last_change":"2023-08-25T09:42:43.263139+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263139+0000","last_undegraded":"2023-08-25T09:42:43.263139+0000","last_fullsized":"2023-08-25T09:42:43.263139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269087+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269087+0000","last_peered":"2023-08-25T09:42:43.269087+0000","last_clean":"2023-08-25T09:42:43.269087+0000","last_became_active":"2023-08-25T09:42:43.265064+0000","last_became_peered":"2023-08-25T09:42:43.265064+0000","last_unstale":"2023-08-25T09:42:43.269087+0000","last_undegraded":"2023-08-25T09:42:43.269087+0000","last_fullsized":"2023-08-25T09:42:43.269087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:30:21.363562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262964+0000","last_change":"2023-08-25T09:42:43.262964+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262964+0000","last_undegraded":"2023-08-25T09:42:43.262964+0000","last_fullsized":"2023-08-25T09:42:43.262964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277387+0000","last_change":"2023-08-25T09:42:43.276586+0000","last_active":"2023-08-25T09:42:43.277387+0000","last_peered":"2023-08-25T09:42:43.277387+0000","last_clean":"2023-08-25T09:42:43.277387+0000","last_became_active":"2023-08-25T09:42:43.276311+0000","last_became_peered":"2023-08-25T09:42:43.276311+0000","last_unstale":"2023-08-25T09:42:43.277387+0000","last_undegraded":"2023-08-25T09:42:43.277387+0000","last_fullsized":"2023-08-25T09:42:43.277387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:17:09.330315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263305+0000","last_change":"2023-08-25T09:42:43.263305+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263305+0000","last_undegraded":"2023-08-25T09:42:43.263305+0000","last_fullsized":"2023-08-25T09:42:43.263305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276924+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.276924+0000","last_peered":"2023-08-25T09:42:43.276924+0000","last_clean":"2023-08-25T09:42:43.276924+0000","last_became_active":"2023-08-25T09:42:43.275295+0000","last_became_peered":"2023-08-25T09:42:43.275295+0000","last_unstale":"2023-08-25T09:42:43.276924+0000","last_undegraded":"2023-08-25T09:42:43.276924+0000","last_fullsized":"2023-08-25T09:42:43.276924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:37.726279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.258959+0000","last_change":"2023-08-25T09:42:43.258959+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.258959+0000","last_undegraded":"2023-08-25T09:42:43.258959+0000","last_fullsized":"2023-08-25T09:42:43.258959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271742+0000","last_change":"2023-08-25T09:42:43.268508+0000","last_active":"2023-08-25T09:42:43.271742+0000","last_peered":"2023-08-25T09:42:43.271742+0000","last_clean":"2023-08-25T09:42:43.271742+0000","last_became_active":"2023-08-25T09:42:43.268143+0000","last_became_peered":"2023-08-25T09:42:43.268143+0000","last_unstale":"2023-08-25T09:42:43.271742+0000","last_undegraded":"2023-08-25T09:42:43.271742+0000","last_fullsized":"2023-08-25T09:42:43.271742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:38:14.600448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259876+0000","last_change":"2023-08-25T09:42:43.259876+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259876+0000","last_undegraded":"2023-08-25T09:42:43.259876+0000","last_fullsized":"2023-08-25T09:42:43.259876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271668+0000","last_change":"2023-08-25T09:42:43.267210+0000","last_active":"2023-08-25T09:42:43.271668+0000","last_peered":"2023-08-25T09:42:43.271668+0000","last_clean":"2023-08-25T09:42:43.271668+0000","last_became_active":"2023-08-25T09:42:43.266940+0000","last_became_peered":"2023-08-25T09:42:43.266940+0000","last_unstale":"2023-08-25T09:42:43.271668+0000","last_undegraded":"2023-08-25T09:42:43.271668+0000","last_fullsized":"2023-08-25T09:42:43.271668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:02.785252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261573+0000","last_change":"2023-08-25T09:42:43.261573+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261573+0000","last_undegraded":"2023-08-25T09:42:43.261573+0000","last_fullsized":"2023-08-25T09:42:43.261573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278080+0000","last_change":"2023-08-25T09:42:43.276967+0000","last_active":"2023-08-25T09:42:43.278080+0000","last_peered":"2023-08-25T09:42:43.278080+0000","last_clean":"2023-08-25T09:42:43.278080+0000","last_became_active":"2023-08-25T09:42:43.276646+0000","last_became_peered":"2023-08-25T09:42:43.276646+0000","last_unstale":"2023-08-25T09:42:43.278080+0000","last_undegraded":"2023-08-25T09:42:43.278080+0000","last_fullsized":"2023-08-25T09:42:43.278080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:12.082587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262991+0000","last_change":"2023-08-25T09:42:43.262991+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262991+0000","last_undegraded":"2023-08-25T09:42:43.262991+0000","last_fullsized":"2023-08-25T09:42:43.262991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275811+0000","last_change":"2023-08-25T09:42:43.274167+0000","last_active":"2023-08-25T09:42:43.275811+0000","last_peered":"2023-08-25T09:42:43.275811+0000","last_clean":"2023-08-25T09:42:43.275811+0000","last_became_active":"2023-08-25T09:42:43.273457+0000","last_became_peered":"2023-08-25T09:42:43.273457+0000","last_unstale":"2023-08-25T09:42:43.275811+0000","last_undegraded":"2023-08-25T09:42:43.275811+0000","last_fullsized":"2023-08-25T09:42:43.275811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:49.533731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.263833+0000","last_change":"2023-08-25T09:42:43.263833+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.263833+0000","last_undegraded":"2023-08-25T09:42:43.263833+0000","last_fullsized":"2023-08-25T09:42:43.263833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276310+0000","last_change":"2023-08-25T09:42:43.273820+0000","last_active":"2023-08-25T09:42:43.276310+0000","last_peered":"2023-08-25T09:42:43.276310+0000","last_clean":"2023-08-25T09:42:43.276310+0000","last_became_active":"2023-08-25T09:42:43.273362+0000","last_became_peered":"2023-08-25T09:42:43.273362+0000","last_unstale":"2023-08-25T09:42:43.276310+0000","last_undegraded":"2023-08-25T09:42:43.276310+0000","last_fullsized":"2023-08-25T09:42:43.276310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:30:11.556739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264574+0000","last_change":"2023-08-25T09:42:43.264574+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264574+0000","last_undegraded":"2023-08-25T09:42:43.264574+0000","last_fullsized":"2023-08-25T09:42:43.264574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277358+0000","last_change":"2023-08-25T09:42:43.276386+0000","last_active":"2023-08-25T09:42:43.277358+0000","last_peered":"2023-08-25T09:42:43.277358+0000","last_clean":"2023-08-25T09:42:43.277358+0000","last_became_active":"2023-08-25T09:42:43.276029+0000","last_became_peered":"2023-08-25T09:42:43.276029+0000","last_unstale":"2023-08-25T09:42:43.277358+0000","last_undegraded":"2023-08-25T09:42:43.277358+0000","last_fullsized":"2023-08-25T09:42:43.277358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:10.071794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262312+0000","last_change":"2023-08-25T09:42:43.262312+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262312+0000","last_undegraded":"2023-08-25T09:42:43.262312+0000","last_fullsized":"2023-08-25T09:42:43.262312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.275617+0000","last_change":"2023-08-25T09:42:43.273234+0000","last_active":"2023-08-25T09:42:43.275617+0000","last_peered":"2023-08-25T09:42:43.275617+0000","last_clean":"2023-08-25T09:42:43.275617+0000","last_became_active":"2023-08-25T09:42:43.272846+0000","last_became_peered":"2023-08-25T09:42:43.272846+0000","last_unstale":"2023-08-25T09:42:43.275617+0000","last_undegraded":"2023-08-25T09:42:43.275617+0000","last_fullsized":"2023-08-25T09:42:43.275617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:22:28.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259960+0000","last_change":"2023-08-25T09:42:43.259960+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259960+0000","last_undegraded":"2023-08-25T09:42:43.259960+0000","last_fullsized":"2023-08-25T09:42:43.259960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274963+0000","last_change":"2023-08-25T09:42:43.271438+0000","last_active":"2023-08-25T09:42:43.274963+0000","last_peered":"2023-08-25T09:42:43.274963+0000","last_clean":"2023-08-25T09:42:43.274963+0000","last_became_active":"2023-08-25T09:42:43.271184+0000","last_became_peered":"2023-08-25T09:42:43.271184+0000","last_unstale":"2023-08-25T09:42:43.274963+0000","last_undegraded":"2023-08-25T09:42:43.274963+0000","last_fullsized":"2023-08-25T09:42:43.274963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:48.671798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260382+0000","last_change":"2023-08-25T09:42:43.260382+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260382+0000","last_undegraded":"2023-08-25T09:42:43.260382+0000","last_fullsized":"2023-08-25T09:42:43.260382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274356+0000","last_change":"2023-08-25T09:42:43.270977+0000","last_active":"2023-08-25T09:42:43.274356+0000","last_peered":"2023-08-25T09:42:43.274356+0000","last_clean":"2023-08-25T09:42:43.274356+0000","last_became_active":"2023-08-25T09:42:43.270702+0000","last_became_peered":"2023-08-25T09:42:43.270702+0000","last_unstale":"2023-08-25T09:42:43.274356+0000","last_undegraded":"2023-08-25T09:42:43.274356+0000","last_fullsized":"2023-08-25T09:42:43.274356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:21.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262444+0000","last_change":"2023-08-25T09:42:43.262444+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262444+0000","last_undegraded":"2023-08-25T09:42:43.262444+0000","last_fullsized":"2023-08-25T09:42:43.262444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274363+0000","last_change":"2023-08-25T09:42:43.268849+0000","last_active":"2023-08-25T09:42:43.274363+0000","last_peered":"2023-08-25T09:42:43.274363+0000","last_clean":"2023-08-25T09:42:43.274363+0000","last_became_active":"2023-08-25T09:42:43.268561+0000","last_became_peered":"2023-08-25T09:42:43.268561+0000","last_unstale":"2023-08-25T09:42:43.274363+0000","last_undegraded":"2023-08-25T09:42:43.274363+0000","last_fullsized":"2023-08-25T09:42:43.274363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:35:49.609217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259747+0000","last_change":"2023-08-25T09:42:43.259747+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259747+0000","last_undegraded":"2023-08-25T09:42:43.259747+0000","last_fullsized":"2023-08-25T09:42:43.259747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274213+0000","last_change":"2023-08-25T09:42:43.267133+0000","last_active":"2023-08-25T09:42:43.274213+0000","last_peered":"2023-08-25T09:42:43.274213+0000","last_clean":"2023-08-25T09:42:43.274213+0000","last_became_active":"2023-08-25T09:42:43.266868+0000","last_became_peered":"2023-08-25T09:42:43.266868+0000","last_unstale":"2023-08-25T09:42:43.274213+0000","last_undegraded":"2023-08-25T09:42:43.274213+0000","last_fullsized":"2023-08-25T09:42:43.274213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:04.490031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261974+0000","last_change":"2023-08-25T09:42:43.261974+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261974+0000","last_undegraded":"2023-08-25T09:42:43.261974+0000","last_fullsized":"2023-08-25T09:42:43.261974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272464+0000","last_change":"2023-08-25T09:42:43.270692+0000","last_active":"2023-08-25T09:42:43.272464+0000","last_peered":"2023-08-25T09:42:43.272464+0000","last_clean":"2023-08-25T09:42:43.272464+0000","last_became_active":"2023-08-25T09:42:43.270431+0000","last_became_peered":"2023-08-25T09:42:43.270431+0000","last_unstale":"2023-08-25T09:42:43.272464+0000","last_undegraded":"2023-08-25T09:42:43.272464+0000","last_fullsized":"2023-08-25T09:42:43.272464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259665+0000","last_change":"2023-08-25T09:42:43.259665+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259665+0000","last_undegraded":"2023-08-25T09:42:43.259665+0000","last_fullsized":"2023-08-25T09:42:43.259665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274915+0000","last_change":"2023-08-25T09:42:43.270252+0000","last_active":"2023-08-25T09:42:43.274915+0000","last_peered":"2023-08-25T09:42:43.274915+0000","last_clean":"2023-08-25T09:42:43.274915+0000","last_became_active":"2023-08-25T09:42:43.269931+0000","last_became_peered":"2023-08-25T09:42:43.269931+0000","last_unstale":"2023-08-25T09:42:43.274915+0000","last_undegraded":"2023-08-25T09:42:43.274915+0000","last_fullsized":"2023-08-25T09:42:43.274915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:39:53.965422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262501+0000","last_change":"2023-08-25T09:42:43.262501+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262501+0000","last_undegraded":"2023-08-25T09:42:43.262501+0000","last_fullsized":"2023-08-25T09:42:43.262501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.276362+0000","last_change":"2023-08-25T09:42:43.275120+0000","last_active":"2023-08-25T09:42:43.276362+0000","last_peered":"2023-08-25T09:42:43.276362+0000","last_clean":"2023-08-25T09:42:43.276362+0000","last_became_active":"2023-08-25T09:42:43.274864+0000","last_became_peered":"2023-08-25T09:42:43.274864+0000","last_unstale":"2023-08-25T09:42:43.276362+0000","last_undegraded":"2023-08-25T09:42:43.276362+0000","last_fullsized":"2023-08-25T09:42:43.276362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:38.615225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266390+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:43.266390+0000","last_peered":"2023-08-25T09:42:43.266390+0000","last_clean":"2023-08-25T09:42:43.266390+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:43.266390+0000","last_undegraded":"2023-08-25T09:42:43.266390+0000","last_fullsized":"2023-08-25T09:42:43.266390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:21:35.220456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271808+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:43.271808+0000","last_peered":"2023-08-25T09:42:43.271808+0000","last_clean":"2023-08-25T09:42:43.271808+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:43.271808+0000","last_undegraded":"2023-08-25T09:42:43.271808+0000","last_fullsized":"2023-08-25T09:42:43.271808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:50:11.594013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.261413+0000","last_change":"2023-08-25T09:42:43.261413+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.261413+0000","last_undegraded":"2023-08-25T09:42:43.261413+0000","last_fullsized":"2023-08-25T09:42:43.261413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.277049+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:43.277049+0000","last_peered":"2023-08-25T09:42:43.277049+0000","last_clean":"2023-08-25T09:42:43.277049+0000","last_became_active":"2023-08-25T09:42:43.275237+0000","last_became_peered":"2023-08-25T09:42:43.275237+0000","last_unstale":"2023-08-25T09:42:43.277049+0000","last_undegraded":"2023-08-25T09:42:43.277049+0000","last_fullsized":"2023-08-25T09:42:43.277049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:49.486016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266259+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:43.266259+0000","last_peered":"2023-08-25T09:42:43.266259+0000","last_clean":"2023-08-25T09:42:43.266259+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:43.266259+0000","last_undegraded":"2023-08-25T09:42:43.266259+0000","last_fullsized":"2023-08-25T09:42:43.266259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:04:36.548473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262490+0000","last_change":"2023-08-25T09:42:43.262490+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262490+0000","last_undegraded":"2023-08-25T09:42:43.262490+0000","last_fullsized":"2023-08-25T09:42:43.262490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.278134+0000","last_change":"2023-08-25T09:42:43.276569+0000","last_active":"2023-08-25T09:42:43.278134+0000","last_peered":"2023-08-25T09:42:43.278134+0000","last_clean":"2023-08-25T09:42:43.278134+0000","last_became_active":"2023-08-25T09:42:43.276306+0000","last_became_peered":"2023-08-25T09:42:43.276306+0000","last_unstale":"2023-08-25T09:42:43.278134+0000","last_undegraded":"2023-08-25T09:42:43.278134+0000","last_fullsized":"2023-08-25T09:42:43.278134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:12:20.185119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.259490+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:43.259490+0000","last_peered":"2023-08-25T09:42:43.259490+0000","last_clean":"2023-08-25T09:42:43.259490+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:43.259490+0000","last_undegraded":"2023-08-25T09:42:43.259490+0000","last_fullsized":"2023-08-25T09:42:43.259490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:19.646446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.262174+0000","last_change":"2023-08-25T09:42:43.262174+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.262174+0000","last_undegraded":"2023-08-25T09:42:43.262174+0000","last_fullsized":"2023-08-25T09:42:43.262174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269613+0000","last_change":"2023-08-25T09:42:43.267196+0000","last_active":"2023-08-25T09:42:43.269613+0000","last_peered":"2023-08-25T09:42:43.269613+0000","last_clean":"2023-08-25T09:42:43.269613+0000","last_became_active":"2023-08-25T09:42:43.266945+0000","last_became_peered":"2023-08-25T09:42:43.266945+0000","last_unstale":"2023-08-25T09:42:43.269613+0000","last_undegraded":"2023-08-25T09:42:43.269613+0000","last_fullsized":"2023-08-25T09:42:43.269613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:13:03.220760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.271657+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:43.271657+0000","last_peered":"2023-08-25T09:42:43.271657+0000","last_clean":"2023-08-25T09:42:43.271657+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:43.271657+0000","last_undegraded":"2023-08-25T09:42:43.271657+0000","last_fullsized":"2023-08-25T09:42:43.271657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:01.957756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259368+0000","last_change":"2023-08-25T09:42:43.259368+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259368+0000","last_undegraded":"2023-08-25T09:42:43.259368+0000","last_fullsized":"2023-08-25T09:42:43.259368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.274716+0000","last_change":"2023-08-25T09:42:43.270865+0000","last_active":"2023-08-25T09:42:43.274716+0000","last_peered":"2023-08-25T09:42:43.274716+0000","last_clean":"2023-08-25T09:42:43.274716+0000","last_became_active":"2023-08-25T09:42:43.270528+0000","last_became_peered":"2023-08-25T09:42:43.270528+0000","last_unstale":"2023-08-25T09:42:43.274716+0000","last_undegraded":"2023-08-25T09:42:43.274716+0000","last_fullsized":"2023-08-25T09:42:43.274716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:02.604480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.261656+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:43.261656+0000","last_peered":"2023-08-25T09:42:43.261656+0000","last_clean":"2023-08-25T09:42:43.261656+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:43.261656+0000","last_undegraded":"2023-08-25T09:42:43.261656+0000","last_fullsized":"2023-08-25T09:42:43.261656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:23.036411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.259879+0000","last_change":"2023-08-25T09:42:43.259879+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.259879+0000","last_undegraded":"2023-08-25T09:42:43.259879+0000","last_fullsized":"2023-08-25T09:42:43.259879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.272362+0000","last_change":"2023-08-25T09:42:43.270587+0000","last_active":"2023-08-25T09:42:43.272362+0000","last_peered":"2023-08-25T09:42:43.272362+0000","last_clean":"2023-08-25T09:42:43.272362+0000","last_became_active":"2023-08-25T09:42:43.270215+0000","last_became_peered":"2023-08-25T09:42:43.270215+0000","last_unstale":"2023-08-25T09:42:43.272362+0000","last_undegraded":"2023-08-25T09:42:43.272362+0000","last_fullsized":"2023-08-25T09:42:43.272362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:20.358964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.266898+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:43.266898+0000","last_peered":"2023-08-25T09:42:43.266898+0000","last_clean":"2023-08-25T09:42:43.266898+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:43.266898+0000","last_undegraded":"2023-08-25T09:42:43.266898+0000","last_fullsized":"2023-08-25T09:42:43.266898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:18.288915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.260072+0000","last_change":"2023-08-25T09:42:43.260072+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.260072+0000","last_undegraded":"2023-08-25T09:42:43.260072+0000","last_fullsized":"2023-08-25T09:42:43.260072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.273966+0000","last_change":"2023-08-25T09:42:43.269888+0000","last_active":"2023-08-25T09:42:43.273966+0000","last_peered":"2023-08-25T09:42:43.273966+0000","last_clean":"2023-08-25T09:42:43.273966+0000","last_became_active":"2023-08-25T09:42:43.269578+0000","last_became_peered":"2023-08-25T09:42:43.269578+0000","last_unstale":"2023-08-25T09:42:43.273966+0000","last_undegraded":"2023-08-25T09:42:43.273966+0000","last_fullsized":"2023-08-25T09:42:43.273966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:28.202168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.262969+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:43.262969+0000","last_peered":"2023-08-25T09:42:43.262969+0000","last_clean":"2023-08-25T09:42:43.262969+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:43.262969+0000","last_undegraded":"2023-08-25T09:42:43.262969+0000","last_fullsized":"2023-08-25T09:42:43.262969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T21:02:02.450633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-08-25T09:42:43.264885+0000","last_change":"2023-08-25T09:42:43.264885+0000","last_active":"2023-08-25T09:42:43.249552+0000","last_peered":"2023-08-25T09:42:43.249552+0000","last_clean":"2023-08-25T09:42:43.249552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T09:42:43.264885+0000","last_undegraded":"2023-08-25T09:42:43.264885+0000","last_fullsized":"2023-08-25T09:42:43.264885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.269004+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:43.269004+0000","last_peered":"2023-08-25T09:42:43.269004+0000","last_clean":"2023-08-25T09:42:43.269004+0000","last_became_active":"2023-08-25T09:42:43.265091+0000","last_became_peered":"2023-08-25T09:42:43.265091+0000","last_unstale":"2023-08-25T09:42:43.269004+0000","last_undegraded":"2023-08-25T09:42:43.269004+0000","last_fullsized":"2023-08-25T09:42:43.269004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:44:40.542410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-25T09:42:43.264119+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:43.264119+0000","last_peered":"2023-08-25T09:42:43.264119+0000","last_clean":"2023-08-25T09:42:43.264119+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:43.264119+0000","last_undegraded":"2023-08-25T09:42:43.264119+0000","last_fullsized":"2023-08-25T09:42:43.264119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:54.470307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":726813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":136445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":733441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:51.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T09:42:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c2b96640 1 Processor -- start 2023-08-25T09:42:51.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c2b96640 1 -- start start 2023-08-25T09:42:51.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c2b96640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0bc0b6ec0 0x7ff0bc0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:51.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c2b96640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc145020 con 0x7ff0bc14ddb0 2023-08-25T09:42:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c2b96640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc0b9330 con 0x7ff0bc144c40 2023-08-25T09:42:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c2b96640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc0b7d70 con 0x7ff0bc0b6ec0 2023-08-25T09:42:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0bbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0bc0b6ec0 0x7ff0bc0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c1133640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff0bc14ddb0 0x7ff0bc1550e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40764/0 (socket says 172.21.15.89:40764) 2023-08-25T09:42:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.712+0000 7ff0c1133640 1 -- 172.21.15.89:0/3448666859 learned_addr learned my addr 172.21.15.89:0/3448666859 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.713+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3448666859 >> v1:172.21.15.121:6789/0 conn(0x7ff0bc144c40 legacy=0x7ff0bc0b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.713+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3448666859 >> v1:172.21.15.89:6789/0 conn(0x7ff0bc14ddb0 legacy=0x7ff0bc1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.713+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3448666859 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0bd290 con 0x7ff0bc0b6ec0 2023-08-25T09:42:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.713+0000 7ff0bb7fe640 1 -- 172.21.15.89:0/3448666859 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566562866 0 0) 0x7ff0bc145020 con 0x7ff0bc14ddb0 2023-08-25T09:42:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.713+0000 7ff0bbfff640 1 --2- 172.21.15.89:0/3448666859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0bcc70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80097a0 tx=0x7ff0a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2509718f89d7eb45 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.713+0000 7ff0bb7fe640 1 -- 172.21.15.89:0/3448666859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8031830 con 0x7ff0bc0b6ec0 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0bb7fe640 1 -- 172.21.15.89:0/3448666859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a8031990 con 0x7ff0bc0b6ec0 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0bb7fe640 1 -- 172.21.15.89:0/3448666859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8031d20 con 0x7ff0bc0b6ec0 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3448666859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc0b6ec0 msgr2=0x7ff0bc0bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3448666859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0bcc70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80097a0 tx=0x7ff0a802b8d0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3448666859 shutdown_connections 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3448666859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0bcc70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3448666859 >> 172.21.15.89:0/3448666859 conn(0x7ff0bc0654f0 msgr2=0x7ff0bc0658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3448666859 shutdown_connections 2023-08-25T09:42:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.714+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3448666859 wait complete. 2023-08-25T09:42:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.715+0000 7ff0c2b96640 1 Processor -- start 2023-08-25T09:42:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.715+0000 7ff0c2b96640 1 -- start start 2023-08-25T09:42:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c2b96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0be160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c2b96640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 0x7ff0bc1d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c2b96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0bc14ddb0 0x7ff0bc1e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c2b96640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1d6020 con 0x7ff0bc144c40 2023-08-25T09:42:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c2b96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc13efd0 con 0x7ff0bc14ddb0 2023-08-25T09:42:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c2b96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0be840 con 0x7ff0bc0b6ec0 2023-08-25T09:42:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 0x7ff0bc1d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 0x7ff0bc1d5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35232/0 (socket says 172.21.15.89:35232) 2023-08-25T09:42:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3873949679 learned_addr learned my addr 172.21.15.89:0/3873949679 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c1133640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0bc14ddb0 0x7ff0bc1e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0bc0b6ec0 msgr2=0x7ff0bc0be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.716+0000 7ff0c0932640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0bbfff640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0bc14ddb0 msgr2=0x7ff0bc1e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0bbfff640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0bc14ddb0 0x7ff0bc1e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0bbfff640 1 -- 172.21.15.89:0/3873949679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8009400 con 0x7ff0bc144c40 2023-08-25T09:42:51.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0c1133640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0bc14ddb0 0x7ff0bc1e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0c0932640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0bbfff640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 0x7ff0bc1d5ae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80097a0 tx=0x7ff0a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a803ca80 con 0x7ff0bc144c40 2023-08-25T09:42:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a803cbe0 con 0x7ff0bc144c40 2023-08-25T09:42:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8004030 con 0x7ff0bc144c40 2023-08-25T09:42:51.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc0c0220 con 0x7ff0bc144c40 2023-08-25T09:42:51.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.717+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc0bfe40 con 0x7ff0bc144c40 2023-08-25T09:42:51.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.718+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc0c0090 con 0x7ff0bc144c40 2023-08-25T09:42:51.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.718+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0a8004190 con 0x7ff0bc144c40 2023-08-25T09:42:51.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.719+0000 7ff0b97fa640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff0a006a080 0x7ff0a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.719+0000 7ff0c0932640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff0a006a080 0x7ff0a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.719+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0a80aad40 con 0x7ff0bc144c40 2023-08-25T09:42:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.719+0000 7ff0c0932640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff0a006a080 0x7ff0a006c540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0003eb0 tx=0x7ff0b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:51.738 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.723+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff0a8076430 con 0x7ff0bc144c40 2023-08-25T09:42:51.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.885+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 --> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0bc0b8b30 con 0x7ff0a006a080 2023-08-25T09:42:51.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.892+0000 7ff0b97fa640 1 -- 172.21.15.89:0/3873949679 <== mgr.4110 v2:172.21.15.89:6832/660095854 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293055 (secure 0 0 0) 0x7ff0b0005030 con 0x7ff0a006a080 2023-08-25T09:42:51.897 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:51.898 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-08-25T09:42:51.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff0a006a080 msgr2=0x7ff0a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:51.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff0a006a080 0x7ff0a006c540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0003eb0 tx=0x7ff0b0009040 comp rx=0 tx=0).stop 2023-08-25T09:42:51.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 msgr2=0x7ff0bc1d5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:51.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 0x7ff0bc1d5ae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80097a0 tx=0x7ff0a80046c0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 shutdown_connections 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff0a006a080 0x7ff0a006c540 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc144c40 0x7ff0bc1d5ae0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0bc14ddb0 0x7ff0bc1e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 --2- 172.21.15.89:0/3873949679 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0bc0b6ec0 0x7ff0bc0be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 >> 172.21.15.89:0/3873949679 conn(0x7ff0bc0654f0 msgr2=0x7ff0bc0baae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:51.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 shutdown_connections 2023-08-25T09:42:51.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:51.895+0000 7ff0c2b96640 1 -- 172.21.15.89:0/3873949679 wait complete. 2023-08-25T09:42:51.909 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-08-25T09:42:50.509792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220432,"kb_used_data":4232,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754288,"statfs":{"total":773094113280,"available":772868390912,"internally_reserved":0,"allocated":4333568,"data_stored":2440388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.255033"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.274047+0000","last_change":"2023-08-25T09:42:44.270621+0000","last_active":"2023-08-25T09:42:45.274047+0000","last_peered":"2023-08-25T09:42:45.274047+0000","last_clean":"2023-08-25T09:42:45.274047+0000","last_became_active":"2023-08-25T09:42:44.270374+0000","last_became_peered":"2023-08-25T09:42:44.270374+0000","last_unstale":"2023-08-25T09:42:45.274047+0000","last_undegraded":"2023-08-25T09:42:45.274047+0000","last_fullsized":"2023-08-25T09:42:45.274047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:37.428896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273828+0000","last_change":"2023-08-25T09:42:44.272801+0000","last_active":"2023-08-25T09:42:45.273828+0000","last_peered":"2023-08-25T09:42:45.273828+0000","last_clean":"2023-08-25T09:42:45.273828+0000","last_became_active":"2023-08-25T09:42:44.272556+0000","last_became_peered":"2023-08-25T09:42:44.272556+0000","last_unstale":"2023-08-25T09:42:45.273828+0000","last_undegraded":"2023-08-25T09:42:45.273828+0000","last_fullsized":"2023-08-25T09:42:45.273828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:23.377145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286253+0000","last_change":"2023-08-25T09:42:44.280219+0000","last_active":"2023-08-25T09:42:45.286253+0000","last_peered":"2023-08-25T09:42:45.286253+0000","last_clean":"2023-08-25T09:42:45.286253+0000","last_became_active":"2023-08-25T09:42:44.279979+0000","last_became_peered":"2023-08-25T09:42:44.279979+0000","last_unstale":"2023-08-25T09:42:45.286253+0000","last_undegraded":"2023-08-25T09:42:45.286253+0000","last_fullsized":"2023-08-25T09:42:45.286253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:06.326661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286650+0000","last_change":"2023-08-25T09:42:44.272243+0000","last_active":"2023-08-25T09:42:45.286650+0000","last_peered":"2023-08-25T09:42:45.286650+0000","last_clean":"2023-08-25T09:42:45.286650+0000","last_became_active":"2023-08-25T09:42:44.271108+0000","last_became_peered":"2023-08-25T09:42:44.271108+0000","last_unstale":"2023-08-25T09:42:45.286650+0000","last_undegraded":"2023-08-25T09:42:45.286650+0000","last_fullsized":"2023-08-25T09:42:45.286650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:00.765857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286255+0000","last_change":"2023-08-25T09:42:44.270545+0000","last_active":"2023-08-25T09:42:45.286255+0000","last_peered":"2023-08-25T09:42:45.286255+0000","last_clean":"2023-08-25T09:42:45.286255+0000","last_became_active":"2023-08-25T09:42:44.270007+0000","last_became_peered":"2023-08-25T09:42:44.270007+0000","last_unstale":"2023-08-25T09:42:45.286255+0000","last_undegraded":"2023-08-25T09:42:45.286255+0000","last_fullsized":"2023-08-25T09:42:45.286255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:58:42.783731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286295+0000","last_change":"2023-08-25T09:42:44.274151+0000","last_active":"2023-08-25T09:42:45.286295+0000","last_peered":"2023-08-25T09:42:45.286295+0000","last_clean":"2023-08-25T09:42:45.286295+0000","last_became_active":"2023-08-25T09:42:44.273864+0000","last_became_peered":"2023-08-25T09:42:44.273864+0000","last_unstale":"2023-08-25T09:42:45.286295+0000","last_undegraded":"2023-08-25T09:42:45.286295+0000","last_fullsized":"2023-08-25T09:42:45.286295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:52:05.075657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286143+0000","last_change":"2023-08-25T09:42:44.281442+0000","last_active":"2023-08-25T09:42:45.286143+0000","last_peered":"2023-08-25T09:42:45.286143+0000","last_clean":"2023-08-25T09:42:45.286143+0000","last_became_active":"2023-08-25T09:42:44.281115+0000","last_became_peered":"2023-08-25T09:42:44.281115+0000","last_unstale":"2023-08-25T09:42:45.286143+0000","last_undegraded":"2023-08-25T09:42:45.286143+0000","last_fullsized":"2023-08-25T09:42:45.286143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:54:19.922984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273489+0000","last_change":"2023-08-25T09:42:44.281804+0000","last_active":"2023-08-25T09:42:45.273489+0000","last_peered":"2023-08-25T09:42:45.273489+0000","last_clean":"2023-08-25T09:42:45.273489+0000","last_became_active":"2023-08-25T09:42:44.281562+0000","last_became_peered":"2023-08-25T09:42:44.281562+0000","last_unstale":"2023-08-25T09:42:45.273489+0000","last_undegraded":"2023-08-25T09:42:45.273489+0000","last_fullsized":"2023-08-25T09:42:45.273489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:18:05.860840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286453+0000","last_change":"2023-08-25T09:42:44.284345+0000","last_active":"2023-08-25T09:42:45.286453+0000","last_peered":"2023-08-25T09:42:45.286453+0000","last_clean":"2023-08-25T09:42:45.286453+0000","last_became_active":"2023-08-25T09:42:44.284090+0000","last_became_peered":"2023-08-25T09:42:44.284090+0000","last_unstale":"2023-08-25T09:42:45.286453+0000","last_undegraded":"2023-08-25T09:42:45.286453+0000","last_fullsized":"2023-08-25T09:42:45.286453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:11:52.176674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287722+0000","last_change":"2023-08-25T09:42:44.282169+0000","last_active":"2023-08-25T09:42:45.287722+0000","last_peered":"2023-08-25T09:42:45.287722+0000","last_clean":"2023-08-25T09:42:45.287722+0000","last_became_active":"2023-08-25T09:42:44.281916+0000","last_became_peered":"2023-08-25T09:42:44.281916+0000","last_unstale":"2023-08-25T09:42:45.287722+0000","last_undegraded":"2023-08-25T09:42:45.287722+0000","last_fullsized":"2023-08-25T09:42:45.287722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:04:09.691528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287432+0000","last_change":"2023-08-25T09:42:44.278698+0000","last_active":"2023-08-25T09:42:45.287432+0000","last_peered":"2023-08-25T09:42:45.287432+0000","last_clean":"2023-08-25T09:42:45.287432+0000","last_became_active":"2023-08-25T09:42:44.278324+0000","last_became_peered":"2023-08-25T09:42:44.278324+0000","last_unstale":"2023-08-25T09:42:45.287432+0000","last_undegraded":"2023-08-25T09:42:45.287432+0000","last_fullsized":"2023-08-25T09:42:45.287432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:22:31.986826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.285893+0000","last_change":"2023-08-25T09:42:44.271935+0000","last_active":"2023-08-25T09:42:45.285893+0000","last_peered":"2023-08-25T09:42:45.285893+0000","last_clean":"2023-08-25T09:42:45.285893+0000","last_became_active":"2023-08-25T09:42:44.271654+0000","last_became_peered":"2023-08-25T09:42:44.271654+0000","last_unstale":"2023-08-25T09:42:45.285893+0000","last_undegraded":"2023-08-25T09:42:45.285893+0000","last_fullsized":"2023-08-25T09:42:45.285893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:29.204531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286541+0000","last_change":"2023-08-25T09:42:44.280047+0000","last_active":"2023-08-25T09:42:45.286541+0000","last_peered":"2023-08-25T09:42:45.286541+0000","last_clean":"2023-08-25T09:42:45.286541+0000","last_became_active":"2023-08-25T09:42:44.279778+0000","last_became_peered":"2023-08-25T09:42:44.279778+0000","last_unstale":"2023-08-25T09:42:45.286541+0000","last_undegraded":"2023-08-25T09:42:45.286541+0000","last_fullsized":"2023-08-25T09:42:45.286541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:37.567094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286880+0000","last_change":"2023-08-25T09:42:44.278642+0000","last_active":"2023-08-25T09:42:45.286880+0000","last_peered":"2023-08-25T09:42:45.286880+0000","last_clean":"2023-08-25T09:42:45.286880+0000","last_became_active":"2023-08-25T09:42:44.278340+0000","last_became_peered":"2023-08-25T09:42:44.278340+0000","last_unstale":"2023-08-25T09:42:45.286880+0000","last_undegraded":"2023-08-25T09:42:45.286880+0000","last_fullsized":"2023-08-25T09:42:45.286880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:54:19.922984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286489+0000","last_change":"2023-08-25T09:42:44.277137+0000","last_active":"2023-08-25T09:42:45.286489+0000","last_peered":"2023-08-25T09:42:45.286489+0000","last_clean":"2023-08-25T09:42:45.286489+0000","last_became_active":"2023-08-25T09:42:44.276641+0000","last_became_peered":"2023-08-25T09:42:44.276641+0000","last_unstale":"2023-08-25T09:42:45.286489+0000","last_undegraded":"2023-08-25T09:42:45.286489+0000","last_fullsized":"2023-08-25T09:42:45.286489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:41:58.987936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.274985+0000","last_change":"2023-08-25T09:42:44.284648+0000","last_active":"2023-08-25T09:42:45.274985+0000","last_peered":"2023-08-25T09:42:45.274985+0000","last_clean":"2023-08-25T09:42:45.274985+0000","last_became_active":"2023-08-25T09:42:44.284388+0000","last_became_peered":"2023-08-25T09:42:44.284388+0000","last_unstale":"2023-08-25T09:42:45.274985+0000","last_undegraded":"2023-08-25T09:42:45.274985+0000","last_fullsized":"2023-08-25T09:42:45.274985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:17:14.830695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275680+0000","last_change":"2023-08-25T09:42:44.285132+0000","last_active":"2023-08-25T09:42:45.275680+0000","last_peered":"2023-08-25T09:42:45.275680+0000","last_clean":"2023-08-25T09:42:45.275680+0000","last_became_active":"2023-08-25T09:42:44.284426+0000","last_became_peered":"2023-08-25T09:42:44.284426+0000","last_unstale":"2023-08-25T09:42:45.275680+0000","last_undegraded":"2023-08-25T09:42:45.275680+0000","last_fullsized":"2023-08-25T09:42:45.275680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:56:22.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286951+0000","last_change":"2023-08-25T09:42:44.275055+0000","last_active":"2023-08-25T09:42:45.286951+0000","last_peered":"2023-08-25T09:42:45.286951+0000","last_clean":"2023-08-25T09:42:45.286951+0000","last_became_active":"2023-08-25T09:42:44.274769+0000","last_became_peered":"2023-08-25T09:42:44.274769+0000","last_unstale":"2023-08-25T09:42:45.286951+0000","last_undegraded":"2023-08-25T09:42:45.286951+0000","last_fullsized":"2023-08-25T09:42:45.286951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:45:08.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286657+0000","last_change":"2023-08-25T09:42:44.271263+0000","last_active":"2023-08-25T09:42:45.286657+0000","last_peered":"2023-08-25T09:42:45.286657+0000","last_clean":"2023-08-25T09:42:45.286657+0000","last_became_active":"2023-08-25T09:42:44.270999+0000","last_became_peered":"2023-08-25T09:42:44.270999+0000","last_unstale":"2023-08-25T09:42:45.286657+0000","last_undegraded":"2023-08-25T09:42:45.286657+0000","last_fullsized":"2023-08-25T09:42:45.286657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:28.242183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286353+0000","last_change":"2023-08-25T09:42:44.275319+0000","last_active":"2023-08-25T09:42:45.286353+0000","last_peered":"2023-08-25T09:42:45.286353+0000","last_clean":"2023-08-25T09:42:45.286353+0000","last_became_active":"2023-08-25T09:42:44.275022+0000","last_became_peered":"2023-08-25T09:42:44.275022+0000","last_unstale":"2023-08-25T09:42:45.286353+0000","last_undegraded":"2023-08-25T09:42:45.286353+0000","last_fullsized":"2023-08-25T09:42:45.286353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:00.765857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286404+0000","last_change":"2023-08-25T09:42:44.277820+0000","last_active":"2023-08-25T09:42:45.286404+0000","last_peered":"2023-08-25T09:42:45.286404+0000","last_clean":"2023-08-25T09:42:45.286404+0000","last_became_active":"2023-08-25T09:42:44.277449+0000","last_became_peered":"2023-08-25T09:42:44.277449+0000","last_unstale":"2023-08-25T09:42:45.286404+0000","last_undegraded":"2023-08-25T09:42:45.286404+0000","last_fullsized":"2023-08-25T09:42:45.286404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:30.328286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287168+0000","last_change":"2023-08-25T09:42:44.272600+0000","last_active":"2023-08-25T09:42:45.287168+0000","last_peered":"2023-08-25T09:42:45.287168+0000","last_clean":"2023-08-25T09:42:45.287168+0000","last_became_active":"2023-08-25T09:42:44.272319+0000","last_became_peered":"2023-08-25T09:42:44.272319+0000","last_unstale":"2023-08-25T09:42:45.287168+0000","last_undegraded":"2023-08-25T09:42:45.287168+0000","last_fullsized":"2023-08-25T09:42:45.287168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:41:58.987936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275026+0000","last_change":"2023-08-25T09:42:44.273720+0000","last_active":"2023-08-25T09:42:45.275026+0000","last_peered":"2023-08-25T09:42:45.275026+0000","last_clean":"2023-08-25T09:42:45.275026+0000","last_became_active":"2023-08-25T09:42:44.273422+0000","last_became_peered":"2023-08-25T09:42:44.273422+0000","last_unstale":"2023-08-25T09:42:45.275026+0000","last_undegraded":"2023-08-25T09:42:45.275026+0000","last_fullsized":"2023-08-25T09:42:45.275026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:44.313044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286059+0000","last_change":"2023-08-25T09:42:44.284052+0000","last_active":"2023-08-25T09:42:45.286059+0000","last_peered":"2023-08-25T09:42:45.286059+0000","last_clean":"2023-08-25T09:42:45.286059+0000","last_became_active":"2023-08-25T09:42:44.283806+0000","last_became_peered":"2023-08-25T09:42:44.283806+0000","last_unstale":"2023-08-25T09:42:45.286059+0000","last_undegraded":"2023-08-25T09:42:45.286059+0000","last_fullsized":"2023-08-25T09:42:45.286059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:20.371681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286553+0000","last_change":"2023-08-25T09:42:44.276890+0000","last_active":"2023-08-25T09:42:45.286553+0000","last_peered":"2023-08-25T09:42:45.286553+0000","last_clean":"2023-08-25T09:42:45.286553+0000","last_became_active":"2023-08-25T09:42:44.276579+0000","last_became_peered":"2023-08-25T09:42:44.276579+0000","last_unstale":"2023-08-25T09:42:45.286553+0000","last_undegraded":"2023-08-25T09:42:45.286553+0000","last_fullsized":"2023-08-25T09:42:45.286553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:28.242183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286867+0000","last_change":"2023-08-25T09:42:44.284976+0000","last_active":"2023-08-25T09:42:45.286867+0000","last_peered":"2023-08-25T09:42:45.286867+0000","last_clean":"2023-08-25T09:42:45.286867+0000","last_became_active":"2023-08-25T09:42:44.284474+0000","last_became_peered":"2023-08-25T09:42:44.284474+0000","last_unstale":"2023-08-25T09:42:45.286867+0000","last_undegraded":"2023-08-25T09:42:45.286867+0000","last_fullsized":"2023-08-25T09:42:45.286867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:54:19.922984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286973+0000","last_change":"2023-08-25T09:42:44.273098+0000","last_active":"2023-08-25T09:42:45.286973+0000","last_peered":"2023-08-25T09:42:45.286973+0000","last_clean":"2023-08-25T09:42:45.286973+0000","last_became_active":"2023-08-25T09:42:44.272842+0000","last_became_peered":"2023-08-25T09:42:44.272842+0000","last_unstale":"2023-08-25T09:42:45.286973+0000","last_undegraded":"2023-08-25T09:42:45.286973+0000","last_fullsized":"2023-08-25T09:42:45.286973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:33:10.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287262+0000","last_change":"2023-08-25T09:42:44.282590+0000","last_active":"2023-08-25T09:42:45.287262+0000","last_peered":"2023-08-25T09:42:45.287262+0000","last_clean":"2023-08-25T09:42:45.287262+0000","last_became_active":"2023-08-25T09:42:44.282307+0000","last_became_peered":"2023-08-25T09:42:44.282307+0000","last_unstale":"2023-08-25T09:42:45.287262+0000","last_undegraded":"2023-08-25T09:42:45.287262+0000","last_fullsized":"2023-08-25T09:42:45.287262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:31.212882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287106+0000","last_change":"2023-08-25T09:42:44.273643+0000","last_active":"2023-08-25T09:42:45.287106+0000","last_peered":"2023-08-25T09:42:45.287106+0000","last_clean":"2023-08-25T09:42:45.287106+0000","last_became_active":"2023-08-25T09:42:44.273386+0000","last_became_peered":"2023-08-25T09:42:44.273386+0000","last_unstale":"2023-08-25T09:42:45.287106+0000","last_undegraded":"2023-08-25T09:42:45.287106+0000","last_fullsized":"2023-08-25T09:42:45.287106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:38:15.602810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286336+0000","last_change":"2023-08-25T09:42:44.277955+0000","last_active":"2023-08-25T09:42:45.286336+0000","last_peered":"2023-08-25T09:42:45.286336+0000","last_clean":"2023-08-25T09:42:45.286336+0000","last_became_active":"2023-08-25T09:42:44.277690+0000","last_became_peered":"2023-08-25T09:42:44.277690+0000","last_unstale":"2023-08-25T09:42:45.286336+0000","last_undegraded":"2023-08-25T09:42:45.286336+0000","last_fullsized":"2023-08-25T09:42:45.286336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:30.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275226+0000","last_change":"2023-08-25T09:42:44.282564+0000","last_active":"2023-08-25T09:42:45.275226+0000","last_peered":"2023-08-25T09:42:45.275226+0000","last_clean":"2023-08-25T09:42:45.275226+0000","last_became_active":"2023-08-25T09:42:44.282288+0000","last_became_peered":"2023-08-25T09:42:44.282288+0000","last_unstale":"2023-08-25T09:42:45.275226+0000","last_undegraded":"2023-08-25T09:42:45.275226+0000","last_fullsized":"2023-08-25T09:42:45.275226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:17.167882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.285985+0000","last_change":"2023-08-25T09:42:44.269763+0000","last_active":"2023-08-25T09:42:45.285985+0000","last_peered":"2023-08-25T09:42:45.285985+0000","last_clean":"2023-08-25T09:42:45.285985+0000","last_became_active":"2023-08-25T09:42:44.269486+0000","last_became_peered":"2023-08-25T09:42:44.269486+0000","last_unstale":"2023-08-25T09:42:45.285985+0000","last_undegraded":"2023-08-25T09:42:45.285985+0000","last_fullsized":"2023-08-25T09:42:45.285985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:23.377145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275369+0000","last_change":"2023-08-25T09:42:44.280236+0000","last_active":"2023-08-25T09:42:45.275369+0000","last_peered":"2023-08-25T09:42:45.275369+0000","last_clean":"2023-08-25T09:42:45.275369+0000","last_became_active":"2023-08-25T09:42:44.279964+0000","last_became_peered":"2023-08-25T09:42:44.279964+0000","last_unstale":"2023-08-25T09:42:45.275369+0000","last_undegraded":"2023-08-25T09:42:45.275369+0000","last_fullsized":"2023-08-25T09:42:45.275369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:54:40.244991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286654+0000","last_change":"2023-08-25T09:42:43.274652+0000","last_active":"2023-08-25T09:42:45.286654+0000","last_peered":"2023-08-25T09:42:45.286654+0000","last_clean":"2023-08-25T09:42:45.286654+0000","last_became_active":"2023-08-25T09:42:43.274360+0000","last_became_peered":"2023-08-25T09:42:43.274360+0000","last_unstale":"2023-08-25T09:42:45.286654+0000","last_undegraded":"2023-08-25T09:42:45.286654+0000","last_fullsized":"2023-08-25T09:42:45.286654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:13:03.220760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286668+0000","last_change":"2023-08-25T09:42:44.281844+0000","last_active":"2023-08-25T09:42:45.286668+0000","last_peered":"2023-08-25T09:42:45.286668+0000","last_clean":"2023-08-25T09:42:45.286668+0000","last_became_active":"2023-08-25T09:42:44.281552+0000","last_became_peered":"2023-08-25T09:42:44.281552+0000","last_unstale":"2023-08-25T09:42:45.286668+0000","last_undegraded":"2023-08-25T09:42:45.286668+0000","last_fullsized":"2023-08-25T09:42:45.286668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:37.428896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286556+0000","last_change":"2023-08-25T09:42:43.269611+0000","last_active":"2023-08-25T09:42:45.286556+0000","last_peered":"2023-08-25T09:42:45.286556+0000","last_clean":"2023-08-25T09:42:45.286556+0000","last_became_active":"2023-08-25T09:42:43.269334+0000","last_became_peered":"2023-08-25T09:42:43.269334+0000","last_unstale":"2023-08-25T09:42:45.286556+0000","last_undegraded":"2023-08-25T09:42:45.286556+0000","last_fullsized":"2023-08-25T09:42:45.286556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:18:04.858478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287636+0000","last_change":"2023-08-25T09:42:44.278906+0000","last_active":"2023-08-25T09:42:45.287636+0000","last_peered":"2023-08-25T09:42:45.287636+0000","last_clean":"2023-08-25T09:42:45.287636+0000","last_became_active":"2023-08-25T09:42:44.278467+0000","last_became_peered":"2023-08-25T09:42:44.278467+0000","last_unstale":"2023-08-25T09:42:45.287636+0000","last_undegraded":"2023-08-25T09:42:45.287636+0000","last_fullsized":"2023-08-25T09:42:45.287636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:44.313044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286792+0000","last_change":"2023-08-25T09:42:43.270208+0000","last_active":"2023-08-25T09:42:45.286792+0000","last_peered":"2023-08-25T09:42:45.286792+0000","last_clean":"2023-08-25T09:42:45.286792+0000","last_became_active":"2023-08-25T09:42:43.269906+0000","last_became_peered":"2023-08-25T09:42:43.269906+0000","last_unstale":"2023-08-25T09:42:45.286792+0000","last_undegraded":"2023-08-25T09:42:45.286792+0000","last_fullsized":"2023-08-25T09:42:45.286792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:10:49.862867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273879+0000","last_change":"2023-08-25T09:42:44.277709+0000","last_active":"2023-08-25T09:42:45.273879+0000","last_peered":"2023-08-25T09:42:45.273879+0000","last_clean":"2023-08-25T09:42:45.273879+0000","last_became_active":"2023-08-25T09:42:44.277452+0000","last_became_peered":"2023-08-25T09:42:44.277452+0000","last_unstale":"2023-08-25T09:42:45.273879+0000","last_undegraded":"2023-08-25T09:42:45.273879+0000","last_fullsized":"2023-08-25T09:42:45.273879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:40.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287360+0000","last_change":"2023-08-25T09:42:43.269894+0000","last_active":"2023-08-25T09:42:45.287360+0000","last_peered":"2023-08-25T09:42:45.287360+0000","last_clean":"2023-08-25T09:42:45.287360+0000","last_became_active":"2023-08-25T09:42:43.269588+0000","last_became_peered":"2023-08-25T09:42:43.269588+0000","last_unstale":"2023-08-25T09:42:45.287360+0000","last_undegraded":"2023-08-25T09:42:45.287360+0000","last_fullsized":"2023-08-25T09:42:45.287360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:36.564731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.285709+0000","last_change":"2023-08-25T09:42:44.271961+0000","last_active":"2023-08-25T09:42:45.285709+0000","last_peered":"2023-08-25T09:42:45.285709+0000","last_clean":"2023-08-25T09:42:45.285709+0000","last_became_active":"2023-08-25T09:42:44.271691+0000","last_became_peered":"2023-08-25T09:42:44.271691+0000","last_unstale":"2023-08-25T09:42:45.285709+0000","last_undegraded":"2023-08-25T09:42:45.285709+0000","last_fullsized":"2023-08-25T09:42:45.285709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:50:59.631759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286474+0000","last_change":"2023-08-25T09:42:43.274532+0000","last_active":"2023-08-25T09:42:45.286474+0000","last_peered":"2023-08-25T09:42:45.286474+0000","last_clean":"2023-08-25T09:42:45.286474+0000","last_became_active":"2023-08-25T09:42:43.274259+0000","last_became_peered":"2023-08-25T09:42:43.274259+0000","last_unstale":"2023-08-25T09:42:45.286474+0000","last_undegraded":"2023-08-25T09:42:45.286474+0000","last_fullsized":"2023-08-25T09:42:45.286474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:46.745207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286352+0000","last_change":"2023-08-25T09:42:44.276942+0000","last_active":"2023-08-25T09:42:45.286352+0000","last_peered":"2023-08-25T09:42:45.286352+0000","last_clean":"2023-08-25T09:42:45.286352+0000","last_became_active":"2023-08-25T09:42:44.276340+0000","last_became_peered":"2023-08-25T09:42:44.276340+0000","last_unstale":"2023-08-25T09:42:45.286352+0000","last_undegraded":"2023-08-25T09:42:45.286352+0000","last_fullsized":"2023-08-25T09:42:45.286352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:06:29.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275152+0000","last_change":"2023-08-25T09:42:43.271395+0000","last_active":"2023-08-25T09:42:45.275152+0000","last_peered":"2023-08-25T09:42:45.275152+0000","last_clean":"2023-08-25T09:42:45.275152+0000","last_became_active":"2023-08-25T09:42:43.271122+0000","last_became_peered":"2023-08-25T09:42:43.271122+0000","last_unstale":"2023-08-25T09:42:45.275152+0000","last_undegraded":"2023-08-25T09:42:45.275152+0000","last_fullsized":"2023-08-25T09:42:45.275152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:22:30.984463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287079+0000","last_change":"2023-08-25T09:42:44.282063+0000","last_active":"2023-08-25T09:42:45.287079+0000","last_peered":"2023-08-25T09:42:45.287079+0000","last_clean":"2023-08-25T09:42:45.287079+0000","last_became_active":"2023-08-25T09:42:44.281614+0000","last_became_peered":"2023-08-25T09:42:44.281614+0000","last_unstale":"2023-08-25T09:42:45.287079+0000","last_undegraded":"2023-08-25T09:42:45.287079+0000","last_fullsized":"2023-08-25T09:42:45.287079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:30.328286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286230+0000","last_change":"2023-08-25T09:42:43.275402+0000","last_active":"2023-08-25T09:42:45.286230+0000","last_peered":"2023-08-25T09:42:45.286230+0000","last_clean":"2023-08-25T09:42:45.286230+0000","last_became_active":"2023-08-25T09:42:43.275116+0000","last_became_peered":"2023-08-25T09:42:43.275116+0000","last_unstale":"2023-08-25T09:42:45.286230+0000","last_undegraded":"2023-08-25T09:42:45.286230+0000","last_fullsized":"2023-08-25T09:42:45.286230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:00.087317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273952+0000","last_change":"2023-08-25T09:42:44.283704+0000","last_active":"2023-08-25T09:42:45.273952+0000","last_peered":"2023-08-25T09:42:45.273952+0000","last_clean":"2023-08-25T09:42:45.273952+0000","last_became_active":"2023-08-25T09:42:44.283453+0000","last_became_peered":"2023-08-25T09:42:44.283453+0000","last_unstale":"2023-08-25T09:42:45.273952+0000","last_undegraded":"2023-08-25T09:42:45.273952+0000","last_fullsized":"2023-08-25T09:42:45.273952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:52:05.075657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286770+0000","last_change":"2023-08-25T09:42:43.269075+0000","last_active":"2023-08-25T09:42:45.286770+0000","last_peered":"2023-08-25T09:42:45.286770+0000","last_clean":"2023-08-25T09:42:45.286770+0000","last_became_active":"2023-08-25T09:42:43.268787+0000","last_became_peered":"2023-08-25T09:42:43.268787+0000","last_unstale":"2023-08-25T09:42:45.286770+0000","last_undegraded":"2023-08-25T09:42:45.286770+0000","last_fullsized":"2023-08-25T09:42:45.286770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:10:49.862867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286647+0000","last_change":"2023-08-25T09:42:44.271546+0000","last_active":"2023-08-25T09:42:45.286647+0000","last_peered":"2023-08-25T09:42:45.286647+0000","last_clean":"2023-08-25T09:42:45.286647+0000","last_became_active":"2023-08-25T09:42:44.271176+0000","last_became_peered":"2023-08-25T09:42:44.271176+0000","last_unstale":"2023-08-25T09:42:45.286647+0000","last_undegraded":"2023-08-25T09:42:45.286647+0000","last_fullsized":"2023-08-25T09:42:45.286647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:30.600754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273991+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:45.273991+0000","last_peered":"2023-08-25T09:42:45.273991+0000","last_clean":"2023-08-25T09:42:45.273991+0000","last_became_active":"2023-08-25T09:42:43.265064+0000","last_became_peered":"2023-08-25T09:42:43.265064+0000","last_unstale":"2023-08-25T09:42:45.273991+0000","last_undegraded":"2023-08-25T09:42:45.273991+0000","last_fullsized":"2023-08-25T09:42:45.273991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:52:58.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275586+0000","last_change":"2023-08-25T09:42:44.280508+0000","last_active":"2023-08-25T09:42:45.275586+0000","last_peered":"2023-08-25T09:42:45.275586+0000","last_clean":"2023-08-25T09:42:45.275586+0000","last_became_active":"2023-08-25T09:42:44.276753+0000","last_became_peered":"2023-08-25T09:42:44.276753+0000","last_unstale":"2023-08-25T09:42:45.275586+0000","last_undegraded":"2023-08-25T09:42:45.275586+0000","last_fullsized":"2023-08-25T09:42:45.275586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:30:02.856259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287536+0000","last_change":"2023-08-25T09:42:43.276586+0000","last_active":"2023-08-25T09:42:45.287536+0000","last_peered":"2023-08-25T09:42:45.287536+0000","last_clean":"2023-08-25T09:42:45.287536+0000","last_became_active":"2023-08-25T09:42:43.276311+0000","last_became_peered":"2023-08-25T09:42:43.276311+0000","last_unstale":"2023-08-25T09:42:45.287536+0000","last_undegraded":"2023-08-25T09:42:45.287536+0000","last_fullsized":"2023-08-25T09:42:45.287536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:59.208035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286443+0000","last_change":"2023-08-25T09:42:44.274832+0000","last_active":"2023-08-25T09:42:45.286443+0000","last_peered":"2023-08-25T09:42:45.286443+0000","last_clean":"2023-08-25T09:42:45.286443+0000","last_became_active":"2023-08-25T09:42:44.274542+0000","last_became_peered":"2023-08-25T09:42:44.274542+0000","last_unstale":"2023-08-25T09:42:45.286443+0000","last_undegraded":"2023-08-25T09:42:45.286443+0000","last_fullsized":"2023-08-25T09:42:45.286443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:39.617587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287550+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:45.287550+0000","last_peered":"2023-08-25T09:42:45.287550+0000","last_clean":"2023-08-25T09:42:45.287550+0000","last_became_active":"2023-08-25T09:42:43.275295+0000","last_became_peered":"2023-08-25T09:42:43.275295+0000","last_unstale":"2023-08-25T09:42:45.287550+0000","last_undegraded":"2023-08-25T09:42:45.287550+0000","last_fullsized":"2023-08-25T09:42:45.287550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:16.165519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287568+0000","last_change":"2023-08-25T09:42:44.269459+0000","last_active":"2023-08-25T09:42:45.287568+0000","last_peered":"2023-08-25T09:42:45.287568+0000","last_clean":"2023-08-25T09:42:45.287568+0000","last_became_active":"2023-08-25T09:42:44.269161+0000","last_became_peered":"2023-08-25T09:42:44.269161+0000","last_unstale":"2023-08-25T09:42:45.287568+0000","last_undegraded":"2023-08-25T09:42:45.287568+0000","last_fullsized":"2023-08-25T09:42:45.287568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:54.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273843+0000","last_change":"2023-08-25T09:42:43.268508+0000","last_active":"2023-08-25T09:42:45.273843+0000","last_peered":"2023-08-25T09:42:45.273843+0000","last_clean":"2023-08-25T09:42:45.273843+0000","last_became_active":"2023-08-25T09:42:43.268143+0000","last_became_peered":"2023-08-25T09:42:43.268143+0000","last_unstale":"2023-08-25T09:42:45.273843+0000","last_undegraded":"2023-08-25T09:42:45.273843+0000","last_fullsized":"2023-08-25T09:42:45.273843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:39.730046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.285724+0000","last_change":"2023-08-25T09:42:44.280195+0000","last_active":"2023-08-25T09:42:45.285724+0000","last_peered":"2023-08-25T09:42:45.285724+0000","last_clean":"2023-08-25T09:42:45.285724+0000","last_became_active":"2023-08-25T09:42:44.279881+0000","last_became_peered":"2023-08-25T09:42:44.279881+0000","last_unstale":"2023-08-25T09:42:45.285724+0000","last_undegraded":"2023-08-25T09:42:45.285724+0000","last_fullsized":"2023-08-25T09:42:45.285724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:20.769372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.274063+0000","last_change":"2023-08-25T09:42:43.267210+0000","last_active":"2023-08-25T09:42:45.274063+0000","last_peered":"2023-08-25T09:42:45.274063+0000","last_clean":"2023-08-25T09:42:45.274063+0000","last_became_active":"2023-08-25T09:42:43.266940+0000","last_became_peered":"2023-08-25T09:42:43.266940+0000","last_unstale":"2023-08-25T09:42:45.274063+0000","last_undegraded":"2023-08-25T09:42:45.274063+0000","last_fullsized":"2023-08-25T09:42:45.274063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:54:18.920622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273586+0000","last_change":"2023-08-25T09:42:44.271501+0000","last_active":"2023-08-25T09:42:45.273586+0000","last_peered":"2023-08-25T09:42:45.273586+0000","last_clean":"2023-08-25T09:42:45.273586+0000","last_became_active":"2023-08-25T09:42:44.271233+0000","last_became_peered":"2023-08-25T09:42:44.271233+0000","last_unstale":"2023-08-25T09:42:45.273586+0000","last_undegraded":"2023-08-25T09:42:45.273586+0000","last_fullsized":"2023-08-25T09:42:45.273586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:55.739778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286340+0000","last_change":"2023-08-25T09:42:43.276967+0000","last_active":"2023-08-25T09:42:45.286340+0000","last_peered":"2023-08-25T09:42:45.286340+0000","last_clean":"2023-08-25T09:42:45.286340+0000","last_became_active":"2023-08-25T09:42:43.276646+0000","last_became_peered":"2023-08-25T09:42:43.276646+0000","last_unstale":"2023-08-25T09:42:45.286340+0000","last_undegraded":"2023-08-25T09:42:45.286340+0000","last_fullsized":"2023-08-25T09:42:45.286340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:52:58.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275048+0000","last_change":"2023-08-25T09:42:44.277580+0000","last_active":"2023-08-25T09:42:45.275048+0000","last_peered":"2023-08-25T09:42:45.275048+0000","last_clean":"2023-08-25T09:42:45.275048+0000","last_became_active":"2023-08-25T09:42:44.277316+0000","last_became_peered":"2023-08-25T09:42:44.277316+0000","last_unstale":"2023-08-25T09:42:45.275048+0000","last_undegraded":"2023-08-25T09:42:45.275048+0000","last_fullsized":"2023-08-25T09:42:45.275048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:31.212882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286513+0000","last_change":"2023-08-25T09:42:43.274167+0000","last_active":"2023-08-25T09:42:45.286513+0000","last_peered":"2023-08-25T09:42:45.286513+0000","last_clean":"2023-08-25T09:42:45.286513+0000","last_became_active":"2023-08-25T09:42:43.273457+0000","last_became_peered":"2023-08-25T09:42:43.273457+0000","last_unstale":"2023-08-25T09:42:45.286513+0000","last_undegraded":"2023-08-25T09:42:45.286513+0000","last_fullsized":"2023-08-25T09:42:45.286513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:44:40.542410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273803+0000","last_change":"2023-08-25T09:42:44.272348+0000","last_active":"2023-08-25T09:42:45.273803+0000","last_peered":"2023-08-25T09:42:45.273803+0000","last_clean":"2023-08-25T09:42:45.273803+0000","last_became_active":"2023-08-25T09:42:44.272102+0000","last_became_peered":"2023-08-25T09:42:44.272102+0000","last_unstale":"2023-08-25T09:42:45.273803+0000","last_undegraded":"2023-08-25T09:42:45.273803+0000","last_fullsized":"2023-08-25T09:42:45.273803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:39.527856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.274879+0000","last_change":"2023-08-25T09:42:43.273820+0000","last_active":"2023-08-25T09:42:45.274879+0000","last_peered":"2023-08-25T09:42:45.274879+0000","last_clean":"2023-08-25T09:42:45.274879+0000","last_became_active":"2023-08-25T09:42:43.273362+0000","last_became_peered":"2023-08-25T09:42:43.273362+0000","last_unstale":"2023-08-25T09:42:45.274879+0000","last_undegraded":"2023-08-25T09:42:45.274879+0000","last_fullsized":"2023-08-25T09:42:45.274879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:36.564731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273956+0000","last_change":"2023-08-25T09:42:44.277300+0000","last_active":"2023-08-25T09:42:45.273956+0000","last_peered":"2023-08-25T09:42:45.273956+0000","last_clean":"2023-08-25T09:42:45.273956+0000","last_became_active":"2023-08-25T09:42:44.276742+0000","last_became_peered":"2023-08-25T09:42:44.276742+0000","last_unstale":"2023-08-25T09:42:45.273956+0000","last_undegraded":"2023-08-25T09:42:45.273956+0000","last_fullsized":"2023-08-25T09:42:45.273956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:23:11.748876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287686+0000","last_change":"2023-08-25T09:42:43.276386+0000","last_active":"2023-08-25T09:42:45.287686+0000","last_peered":"2023-08-25T09:42:45.287686+0000","last_clean":"2023-08-25T09:42:45.287686+0000","last_became_active":"2023-08-25T09:42:43.276029+0000","last_became_peered":"2023-08-25T09:42:43.276029+0000","last_unstale":"2023-08-25T09:42:45.287686+0000","last_undegraded":"2023-08-25T09:42:45.287686+0000","last_fullsized":"2023-08-25T09:42:45.287686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:54:39.242628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287544+0000","last_change":"2023-08-25T09:42:44.278818+0000","last_active":"2023-08-25T09:42:45.287544+0000","last_peered":"2023-08-25T09:42:45.287544+0000","last_clean":"2023-08-25T09:42:45.287544+0000","last_became_active":"2023-08-25T09:42:44.278402+0000","last_became_peered":"2023-08-25T09:42:44.278402+0000","last_unstale":"2023-08-25T09:42:45.287544+0000","last_undegraded":"2023-08-25T09:42:45.287544+0000","last_fullsized":"2023-08-25T09:42:45.287544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:45:13.323473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287685+0000","last_change":"2023-08-25T09:42:43.273234+0000","last_active":"2023-08-25T09:42:45.287685+0000","last_peered":"2023-08-25T09:42:45.287685+0000","last_clean":"2023-08-25T09:42:45.287685+0000","last_became_active":"2023-08-25T09:42:43.272846+0000","last_became_peered":"2023-08-25T09:42:43.272846+0000","last_unstale":"2023-08-25T09:42:45.287685+0000","last_undegraded":"2023-08-25T09:42:45.287685+0000","last_fullsized":"2023-08-25T09:42:45.287685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:25:30.210520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287546+0000","last_change":"2023-08-25T09:42:44.272716+0000","last_active":"2023-08-25T09:42:45.287546+0000","last_peered":"2023-08-25T09:42:45.287546+0000","last_clean":"2023-08-25T09:42:45.287546+0000","last_became_active":"2023-08-25T09:42:44.272467+0000","last_became_peered":"2023-08-25T09:42:44.272467+0000","last_unstale":"2023-08-25T09:42:45.287546+0000","last_undegraded":"2023-08-25T09:42:45.287546+0000","last_fullsized":"2023-08-25T09:42:45.287546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:17:14.830695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286767+0000","last_change":"2023-08-25T09:42:43.271438+0000","last_active":"2023-08-25T09:42:45.286767+0000","last_peered":"2023-08-25T09:42:45.286767+0000","last_clean":"2023-08-25T09:42:45.286767+0000","last_became_active":"2023-08-25T09:42:43.271184+0000","last_became_peered":"2023-08-25T09:42:43.271184+0000","last_unstale":"2023-08-25T09:42:45.286767+0000","last_undegraded":"2023-08-25T09:42:45.286767+0000","last_fullsized":"2023-08-25T09:42:45.286767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:13:03.220760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287000+0000","last_change":"2023-08-25T09:42:44.275796+0000","last_active":"2023-08-25T09:42:45.287000+0000","last_peered":"2023-08-25T09:42:45.287000+0000","last_clean":"2023-08-25T09:42:45.287000+0000","last_became_active":"2023-08-25T09:42:44.275566+0000","last_became_peered":"2023-08-25T09:42:44.275566+0000","last_unstale":"2023-08-25T09:42:45.287000+0000","last_undegraded":"2023-08-25T09:42:45.287000+0000","last_fullsized":"2023-08-25T09:42:45.287000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:45:08.240782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286220+0000","last_change":"2023-08-25T09:42:43.270977+0000","last_active":"2023-08-25T09:42:45.286220+0000","last_peered":"2023-08-25T09:42:45.286220+0000","last_clean":"2023-08-25T09:42:45.286220+0000","last_became_active":"2023-08-25T09:42:43.270702+0000","last_became_peered":"2023-08-25T09:42:43.270702+0000","last_unstale":"2023-08-25T09:42:45.286220+0000","last_undegraded":"2023-08-25T09:42:45.286220+0000","last_fullsized":"2023-08-25T09:42:45.286220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:43.348333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275166+0000","last_change":"2023-08-25T09:42:44.288316+0000","last_active":"2023-08-25T09:42:45.275166+0000","last_peered":"2023-08-25T09:42:45.275166+0000","last_clean":"2023-08-25T09:42:45.275166+0000","last_became_active":"2023-08-25T09:42:44.287713+0000","last_became_peered":"2023-08-25T09:42:44.287713+0000","last_unstale":"2023-08-25T09:42:45.275166+0000","last_undegraded":"2023-08-25T09:42:45.275166+0000","last_fullsized":"2023-08-25T09:42:45.275166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:30:13.622574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286376+0000","last_change":"2023-08-25T09:42:43.268849+0000","last_active":"2023-08-25T09:42:45.286376+0000","last_peered":"2023-08-25T09:42:45.286376+0000","last_clean":"2023-08-25T09:42:45.286376+0000","last_became_active":"2023-08-25T09:42:43.268561+0000","last_became_peered":"2023-08-25T09:42:43.268561+0000","last_unstale":"2023-08-25T09:42:45.286376+0000","last_undegraded":"2023-08-25T09:42:45.286376+0000","last_fullsized":"2023-08-25T09:42:45.286376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:58.369359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.285897+0000","last_change":"2023-08-25T09:42:44.275131+0000","last_active":"2023-08-25T09:42:45.285897+0000","last_peered":"2023-08-25T09:42:45.285897+0000","last_clean":"2023-08-25T09:42:45.285897+0000","last_became_active":"2023-08-25T09:42:44.274632+0000","last_became_peered":"2023-08-25T09:42:44.274632+0000","last_unstale":"2023-08-25T09:42:45.285897+0000","last_undegraded":"2023-08-25T09:42:45.285897+0000","last_fullsized":"2023-08-25T09:42:45.285897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:05:24.586219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286117+0000","last_change":"2023-08-25T09:42:43.267133+0000","last_active":"2023-08-25T09:42:45.286117+0000","last_peered":"2023-08-25T09:42:45.286117+0000","last_clean":"2023-08-25T09:42:45.286117+0000","last_became_active":"2023-08-25T09:42:43.266868+0000","last_became_peered":"2023-08-25T09:42:43.266868+0000","last_unstale":"2023-08-25T09:42:45.286117+0000","last_undegraded":"2023-08-25T09:42:45.286117+0000","last_fullsized":"2023-08-25T09:42:45.286117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:38:57.278578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286666+0000","last_change":"2023-08-25T09:42:44.278652+0000","last_active":"2023-08-25T09:42:45.286666+0000","last_peered":"2023-08-25T09:42:45.286666+0000","last_clean":"2023-08-25T09:42:45.286666+0000","last_became_active":"2023-08-25T09:42:44.278355+0000","last_became_peered":"2023-08-25T09:42:44.278355+0000","last_unstale":"2023-08-25T09:42:45.286666+0000","last_undegraded":"2023-08-25T09:42:45.286666+0000","last_fullsized":"2023-08-25T09:42:45.286666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:54.467006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275375+0000","last_change":"2023-08-25T09:42:43.270692+0000","last_active":"2023-08-25T09:42:45.275375+0000","last_peered":"2023-08-25T09:42:45.275375+0000","last_clean":"2023-08-25T09:42:45.275375+0000","last_became_active":"2023-08-25T09:42:43.270431+0000","last_became_peered":"2023-08-25T09:42:43.270431+0000","last_unstale":"2023-08-25T09:42:45.275375+0000","last_undegraded":"2023-08-25T09:42:45.275375+0000","last_fullsized":"2023-08-25T09:42:45.275375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:04:08.689166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273945+0000","last_change":"2023-08-25T09:42:44.276896+0000","last_active":"2023-08-25T09:42:45.273945+0000","last_peered":"2023-08-25T09:42:45.273945+0000","last_clean":"2023-08-25T09:42:45.273945+0000","last_became_active":"2023-08-25T09:42:44.276639+0000","last_became_peered":"2023-08-25T09:42:44.276639+0000","last_unstale":"2023-08-25T09:42:45.273945+0000","last_undegraded":"2023-08-25T09:42:45.273945+0000","last_fullsized":"2023-08-25T09:42:45.273945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:01.089680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286179+0000","last_change":"2023-08-25T09:42:43.270252+0000","last_active":"2023-08-25T09:42:45.286179+0000","last_peered":"2023-08-25T09:42:45.286179+0000","last_clean":"2023-08-25T09:42:45.286179+0000","last_became_active":"2023-08-25T09:42:43.269931+0000","last_became_peered":"2023-08-25T09:42:43.269931+0000","last_unstale":"2023-08-25T09:42:45.286179+0000","last_undegraded":"2023-08-25T09:42:45.286179+0000","last_fullsized":"2023-08-25T09:42:45.286179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:32:04.586487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287523+0000","last_change":"2023-08-25T09:42:44.283599+0000","last_active":"2023-08-25T09:42:45.287523+0000","last_peered":"2023-08-25T09:42:45.287523+0000","last_clean":"2023-08-25T09:42:45.287523+0000","last_became_active":"2023-08-25T09:42:44.283338+0000","last_became_peered":"2023-08-25T09:42:44.283338+0000","last_unstale":"2023-08-25T09:42:45.287523+0000","last_undegraded":"2023-08-25T09:42:45.287523+0000","last_fullsized":"2023-08-25T09:42:45.287523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:30:13.622574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275510+0000","last_change":"2023-08-25T09:42:43.275120+0000","last_active":"2023-08-25T09:42:45.275510+0000","last_peered":"2023-08-25T09:42:45.275510+0000","last_clean":"2023-08-25T09:42:45.275510+0000","last_became_active":"2023-08-25T09:42:43.274864+0000","last_became_peered":"2023-08-25T09:42:43.274864+0000","last_unstale":"2023-08-25T09:42:45.275510+0000","last_undegraded":"2023-08-25T09:42:45.275510+0000","last_fullsized":"2023-08-25T09:42:45.275510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:39:08.135157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275169+0000","last_change":"2023-08-25T09:41:49.744886+0000","last_active":"2023-08-25T09:42:45.275169+0000","last_peered":"2023-08-25T09:42:45.275169+0000","last_clean":"2023-08-25T09:42:45.275169+0000","last_became_active":"2023-08-25T09:41:49.743831+0000","last_became_peered":"2023-08-25T09:41:49.743831+0000","last_unstale":"2023-08-25T09:42:45.275169+0000","last_undegraded":"2023-08-25T09:42:45.275169+0000","last_fullsized":"2023-08-25T09:42:45.275169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:48.632612+0000","last_clean_scrub_stamp":"2023-08-25T09:41:48.632612+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:18.706533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286613+0000","last_change":"2023-08-25T09:41:56.240620+0000","last_active":"2023-08-25T09:42:45.286613+0000","last_peered":"2023-08-25T09:42:45.286613+0000","last_clean":"2023-08-25T09:42:45.286613+0000","last_became_active":"2023-08-25T09:41:56.240116+0000","last_became_peered":"2023-08-25T09:41:56.240116+0000","last_unstale":"2023-08-25T09:42:45.286613+0000","last_undegraded":"2023-08-25T09:42:45.286613+0000","last_fullsized":"2023-08-25T09:42:45.286613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:16:26.792950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286103+0000","last_change":"2023-08-25T09:42:44.281493+0000","last_active":"2023-08-25T09:42:45.286103+0000","last_peered":"2023-08-25T09:42:45.286103+0000","last_clean":"2023-08-25T09:42:45.286103+0000","last_became_active":"2023-08-25T09:42:44.281233+0000","last_became_peered":"2023-08-25T09:42:44.281233+0000","last_unstale":"2023-08-25T09:42:45.286103+0000","last_undegraded":"2023-08-25T09:42:45.286103+0000","last_fullsized":"2023-08-25T09:42:45.286103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:40.732409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287793+0000","last_change":"2023-08-25T09:42:43.275571+0000","last_active":"2023-08-25T09:42:45.287793+0000","last_peered":"2023-08-25T09:42:45.287793+0000","last_clean":"2023-08-25T09:42:45.287793+0000","last_became_active":"2023-08-25T09:42:43.275237+0000","last_became_peered":"2023-08-25T09:42:43.275237+0000","last_unstale":"2023-08-25T09:42:45.287793+0000","last_undegraded":"2023-08-25T09:42:45.287793+0000","last_fullsized":"2023-08-25T09:42:45.287793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T19:39:08.135157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275037+0000","last_change":"2023-08-25T09:41:56.235420+0000","last_active":"2023-08-25T09:42:45.275037+0000","last_peered":"2023-08-25T09:42:45.275037+0000","last_clean":"2023-08-25T09:42:45.275037+0000","last_became_active":"2023-08-25T09:41:56.235106+0000","last_became_peered":"2023-08-25T09:41:56.235106+0000","last_unstale":"2023-08-25T09:42:45.275037+0000","last_undegraded":"2023-08-25T09:42:45.275037+0000","last_fullsized":"2023-08-25T09:42:45.275037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:06.429260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275717+0000","last_change":"2023-08-25T09:42:44.277063+0000","last_active":"2023-08-25T09:42:45.275717+0000","last_peered":"2023-08-25T09:42:45.275717+0000","last_clean":"2023-08-25T09:42:45.275717+0000","last_became_active":"2023-08-25T09:42:44.276782+0000","last_became_peered":"2023-08-25T09:42:44.276782+0000","last_unstale":"2023-08-25T09:42:45.275717+0000","last_undegraded":"2023-08-25T09:42:45.275717+0000","last_fullsized":"2023-08-25T09:42:45.275717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:31:05.415804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286856+0000","last_change":"2023-08-25T09:42:43.276569+0000","last_active":"2023-08-25T09:42:45.286856+0000","last_peered":"2023-08-25T09:42:45.286856+0000","last_clean":"2023-08-25T09:42:45.286856+0000","last_became_active":"2023-08-25T09:42:43.276306+0000","last_became_peered":"2023-08-25T09:42:43.276306+0000","last_unstale":"2023-08-25T09:42:45.286856+0000","last_undegraded":"2023-08-25T09:42:45.286856+0000","last_fullsized":"2023-08-25T09:42:45.286856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:02.604480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286717+0000","last_change":"2023-08-25T09:41:56.311013+0000","last_active":"2023-08-25T09:42:45.286717+0000","last_peered":"2023-08-25T09:42:45.286717+0000","last_clean":"2023-08-25T09:42:45.286717+0000","last_became_active":"2023-08-25T09:41:56.310727+0000","last_became_peered":"2023-08-25T09:41:56.310727+0000","last_unstale":"2023-08-25T09:42:45.286717+0000","last_undegraded":"2023-08-25T09:42:45.286717+0000","last_fullsized":"2023-08-25T09:42:45.286717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:56:55.768396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.274043+0000","last_change":"2023-08-25T09:42:44.273871+0000","last_active":"2023-08-25T09:42:45.274043+0000","last_peered":"2023-08-25T09:42:45.274043+0000","last_clean":"2023-08-25T09:42:45.274043+0000","last_became_active":"2023-08-25T09:42:44.273583+0000","last_became_peered":"2023-08-25T09:42:44.273583+0000","last_unstale":"2023-08-25T09:42:45.274043+0000","last_undegraded":"2023-08-25T09:42:45.274043+0000","last_fullsized":"2023-08-25T09:42:45.274043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T18:10:50.865229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286115+0000","last_change":"2023-08-25T09:42:43.267196+0000","last_active":"2023-08-25T09:42:45.286115+0000","last_peered":"2023-08-25T09:42:45.286115+0000","last_clean":"2023-08-25T09:42:45.286115+0000","last_became_active":"2023-08-25T09:42:43.266945+0000","last_became_peered":"2023-08-25T09:42:43.266945+0000","last_unstale":"2023-08-25T09:42:45.286115+0000","last_undegraded":"2023-08-25T09:42:45.286115+0000","last_fullsized":"2023-08-25T09:42:45.286115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:22:28.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286768+0000","last_change":"2023-08-25T09:41:56.236520+0000","last_active":"2023-08-25T09:42:45.286768+0000","last_peered":"2023-08-25T09:42:45.286768+0000","last_clean":"2023-08-25T09:42:45.286768+0000","last_became_active":"2023-08-25T09:41:56.236256+0000","last_became_peered":"2023-08-25T09:41:56.236256+0000","last_unstale":"2023-08-25T09:42:45.286768+0000","last_undegraded":"2023-08-25T09:42:45.286768+0000","last_fullsized":"2023-08-25T09:42:45.286768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:41:56.275298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.285857+0000","last_change":"2023-08-25T09:42:44.273296+0000","last_active":"2023-08-25T09:42:45.285857+0000","last_peered":"2023-08-25T09:42:45.285857+0000","last_clean":"2023-08-25T09:42:45.285857+0000","last_became_active":"2023-08-25T09:42:44.273028+0000","last_became_peered":"2023-08-25T09:42:44.273028+0000","last_unstale":"2023-08-25T09:42:45.285857+0000","last_undegraded":"2023-08-25T09:42:45.285857+0000","last_fullsized":"2023-08-25T09:42:45.285857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:30:12.559102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286985+0000","last_change":"2023-08-25T09:42:43.270865+0000","last_active":"2023-08-25T09:42:45.286985+0000","last_peered":"2023-08-25T09:42:45.286985+0000","last_clean":"2023-08-25T09:42:45.286985+0000","last_became_active":"2023-08-25T09:42:43.270528+0000","last_became_peered":"2023-08-25T09:42:43.270528+0000","last_unstale":"2023-08-25T09:42:45.286985+0000","last_undegraded":"2023-08-25T09:42:45.286985+0000","last_fullsized":"2023-08-25T09:42:45.286985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:54.737415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286325+0000","last_change":"2023-08-25T09:41:56.311259+0000","last_active":"2023-08-25T09:42:45.286325+0000","last_peered":"2023-08-25T09:42:45.286325+0000","last_clean":"2023-08-25T09:42:45.286325+0000","last_became_active":"2023-08-25T09:41:56.310937+0000","last_became_peered":"2023-08-25T09:41:56.310937+0000","last_unstale":"2023-08-25T09:42:45.286325+0000","last_undegraded":"2023-08-25T09:42:45.286325+0000","last_fullsized":"2023-08-25T09:42:45.286325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T20:22:23.711130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286168+0000","last_change":"2023-08-25T09:42:44.274078+0000","last_active":"2023-08-25T09:42:45.286168+0000","last_peered":"2023-08-25T09:42:45.286168+0000","last_clean":"2023-08-25T09:42:45.286168+0000","last_became_active":"2023-08-25T09:42:44.273796+0000","last_became_peered":"2023-08-25T09:42:44.273796+0000","last_unstale":"2023-08-25T09:42:45.286168+0000","last_undegraded":"2023-08-25T09:42:45.286168+0000","last_fullsized":"2023-08-25T09:42:45.286168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:40.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286596+0000","last_change":"2023-08-25T09:42:43.270587+0000","last_active":"2023-08-25T09:42:45.286596+0000","last_peered":"2023-08-25T09:42:45.286596+0000","last_clean":"2023-08-25T09:42:45.286596+0000","last_became_active":"2023-08-25T09:42:43.270215+0000","last_became_peered":"2023-08-25T09:42:43.270215+0000","last_unstale":"2023-08-25T09:42:45.286596+0000","last_undegraded":"2023-08-25T09:42:45.286596+0000","last_fullsized":"2023-08-25T09:42:45.286596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:57:42.803780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275744+0000","last_change":"2023-08-25T09:41:56.312634+0000","last_active":"2023-08-25T09:42:45.275744+0000","last_peered":"2023-08-25T09:42:45.275744+0000","last_clean":"2023-08-25T09:42:45.275744+0000","last_became_active":"2023-08-25T09:41:56.312323+0000","last_became_peered":"2023-08-25T09:41:56.312323+0000","last_unstale":"2023-08-25T09:42:45.275744+0000","last_undegraded":"2023-08-25T09:42:45.275744+0000","last_fullsized":"2023-08-25T09:42:45.275744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:48:54.946127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286929+0000","last_change":"2023-08-25T09:42:44.277306+0000","last_active":"2023-08-25T09:42:45.286929+0000","last_peered":"2023-08-25T09:42:45.286929+0000","last_clean":"2023-08-25T09:42:45.286929+0000","last_became_active":"2023-08-25T09:42:44.273846+0000","last_became_peered":"2023-08-25T09:42:44.273846+0000","last_unstale":"2023-08-25T09:42:45.286929+0000","last_undegraded":"2023-08-25T09:42:45.286929+0000","last_fullsized":"2023-08-25T09:42:45.286929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:06:29.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.287102+0000","last_change":"2023-08-25T09:42:43.269888+0000","last_active":"2023-08-25T09:42:45.287102+0000","last_peered":"2023-08-25T09:42:45.287102+0000","last_clean":"2023-08-25T09:42:45.287102+0000","last_became_active":"2023-08-25T09:42:43.269578+0000","last_became_peered":"2023-08-25T09:42:43.269578+0000","last_unstale":"2023-08-25T09:42:45.287102+0000","last_undegraded":"2023-08-25T09:42:45.287102+0000","last_fullsized":"2023-08-25T09:42:45.287102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:46.745207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286910+0000","last_change":"2023-08-25T09:41:56.237539+0000","last_active":"2023-08-25T09:42:45.286910+0000","last_peered":"2023-08-25T09:42:45.286910+0000","last_clean":"2023-08-25T09:42:45.286910+0000","last_became_active":"2023-08-25T09:41:56.237244+0000","last_became_peered":"2023-08-25T09:41:56.237244+0000","last_unstale":"2023-08-25T09:42:45.286910+0000","last_undegraded":"2023-08-25T09:42:45.286910+0000","last_fullsized":"2023-08-25T09:42:45.286910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:41.114773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.275322+0000","last_change":"2023-08-25T09:42:44.279446+0000","last_active":"2023-08-25T09:42:45.275322+0000","last_peered":"2023-08-25T09:42:45.275322+0000","last_clean":"2023-08-25T09:42:45.275322+0000","last_became_active":"2023-08-25T09:42:44.278977+0000","last_became_peered":"2023-08-25T09:42:44.278977+0000","last_unstale":"2023-08-25T09:42:45.275322+0000","last_undegraded":"2023-08-25T09:42:45.275322+0000","last_fullsized":"2023-08-25T09:42:45.275322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:43.249552+0000","last_clean_scrub_stamp":"2023-08-25T09:42:43.249552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:10:00.210398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.273883+0000","last_change":"2023-08-25T09:42:43.265345+0000","last_active":"2023-08-25T09:42:45.273883+0000","last_peered":"2023-08-25T09:42:45.273883+0000","last_clean":"2023-08-25T09:42:45.273883+0000","last_became_active":"2023-08-25T09:42:43.265091+0000","last_became_peered":"2023-08-25T09:42:43.265091+0000","last_unstale":"2023-08-25T09:42:45.273883+0000","last_undegraded":"2023-08-25T09:42:45.273883+0000","last_fullsized":"2023-08-25T09:42:45.273883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:42:42.247189+0000","last_clean_scrub_stamp":"2023-08-25T09:42:42.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:43.348333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-25T09:42:45.286688+0000","last_change":"2023-08-25T09:41:56.237234+0000","last_active":"2023-08-25T09:42:45.286688+0000","last_peered":"2023-08-25T09:42:45.286688+0000","last_clean":"2023-08-25T09:42:45.286688+0000","last_became_active":"2023-08-25T09:41:56.236887+0000","last_became_peered":"2023-08-25T09:41:56.236887+0000","last_unstale":"2023-08-25T09:42:45.286688+0000","last_undegraded":"2023-08-25T09:42:45.286688+0000","last_fullsized":"2023-08-25T09:42:45.286688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T09:41:55.211806+0000","last_clean_scrub_stamp":"2023-08-25T09:41:55.211806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:15.569097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":748904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":157436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":156966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":157458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":158500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32800000000000001}]},{"osd":2,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.438},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.503},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.45400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":156924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.27600000000000002}]},{"osd":1,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.23899999999999999}]},{"osd":3,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.32600000000000001}]},{"osd":4,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.503}]},{"osd":6,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Aug 25 09:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":156944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":747256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T09:42:51.916 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T09:42:51.917 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T09:42:52.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.053+0000 7f6a76883640 1 Processor -- start 2023-08-25T09:42:52.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.053+0000 7f6a76883640 1 -- start start 2023-08-25T09:42:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.053+0000 7f6a76883640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 0x7f6a70141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.053+0000 7f6a76883640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7006e880 con 0x7f6a70070810 2023-08-25T09:42:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.053+0000 7f6a76883640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7014ab90 con 0x7f6a700b7b80 2023-08-25T09:42:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.053+0000 7f6a76883640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b3570 con 0x7f6a701415c0 2023-08-25T09:42:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a74e20640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6a70070810 0x7f6a70151ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40772/0 (socket says 172.21.15.89:40772) 2023-08-25T09:42:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a74e20640 1 -- 172.21.15.89:0/3602912989 learned_addr learned my addr 172.21.15.89:0/3602912989 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581331119 0 0) 0x7f6a7006e880 con 0x7f6a70070810 2023-08-25T09:42:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6f7fe640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 0x7f6a70141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a58003520 con 0x7f6a70070810 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118877550 0 0) 0x7f6a58003520 con 0x7f6a70070810 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 msgr2=0x7f6a70141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 0x7f6a70141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 >> v1:172.21.15.121:6789/0 conn(0x7f6a700b7b80 legacy=0x7f6a700b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700b3000 con 0x7f6a70070810 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f6a680019f0 con 0x7f6a70070810 2023-08-25T09:42:52.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 >> v1:172.21.15.89:6789/0 conn(0x7f6a70070810 legacy=0x7f6a70151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 0x7f6a580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a58003f20 0x7f6a580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58004d00 0x7f6a58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b3570 con 0x7f6a58003f20 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5800ba60 con 0x7f6a58004d00 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5800bc20 con 0x7f6a701415c0 2023-08-25T09:42:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6f7fe640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a58003f20 0x7f6a580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a6ffff640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 0x7f6a580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.054+0000 7f6a74e20640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58004d00 0x7f6a58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6f7fe640 1 -- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 msgr2=0x7f6a580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6f7fe640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701415c0 0x7f6a580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6f7fe640 1 -- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58004d00 msgr2=0x7f6a58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6f7fe640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58004d00 0x7f6a58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6f7fe640 1 -- 172.21.15.89:0/3602912989 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58003520 con 0x7f6a58003f20 2023-08-25T09:42:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a74e20640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58004d00 0x7f6a58005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6f7fe640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a58003f20 0x7f6a580047c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ac0 tx=0x7f6a580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff4d2fc24beb285 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6402c6b0 con 0x7f6a58003f20 2023-08-25T09:42:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6402c810 con 0x7f6a58003f20 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.055+0000 7f6a6effd640 1 -- 172.21.15.89:0/3602912989 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6402cba0 con 0x7f6a58003f20 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a76883640 1 -- 172.21.15.89:0/3602912989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a58003f20 msgr2=0x7f6a580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a76883640 1 --2- 172.21.15.89:0/3602912989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a58003f20 0x7f6a580047c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ac0 tx=0x7f6a580057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a74e20640 1 -- 172.21.15.89:0/3602912989 reap_dead start 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a76883640 1 -- 172.21.15.89:0/3602912989 shutdown_connections 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a76883640 1 -- 172.21.15.89:0/3602912989 >> 172.21.15.89:0/3602912989 conn(0x7f6a700bbe80 msgr2=0x7f6a700bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:52.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a76883640 1 -- 172.21.15.89:0/3602912989 shutdown_connections 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.056+0000 7f6a76883640 1 -- 172.21.15.89:0/3602912989 wait complete. 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.057+0000 7f6a76883640 1 Processor -- start 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.057+0000 7f6a76883640 1 -- start start 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58003f20 0x7f6a700ba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701db940 0x7f6a70149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 0x7f6a701382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700bacb0 con 0x7f6a7014a120 2023-08-25T09:42:52.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700bb9f0 con 0x7f6a58003f20 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701dc920 con 0x7f6a701db940 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 0x7f6a701382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 0x7f6a701382c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35258/0 (socket says 172.21.15.89:35258) 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 -- 172.21.15.89:0/3349935706 learned_addr learned my addr 172.21.15.89:0/3349935706 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a6f7fe640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701db940 0x7f6a70149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a6ffff640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58003f20 0x7f6a700ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 -- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701db940 msgr2=0x7f6a70149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701db940 0x7f6a70149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 -- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58003f20 msgr2=0x7f6a700ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58003f20 0x7f6a700ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 -- 172.21.15.89:0/3349935706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7014a5a0 con 0x7f6a7014a120 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a74e20640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 0x7f6a701382c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006a910 tx=0x7f6a6800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007ae0 con 0x7f6a7014a120 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800eda0 con 0x7f6a7014a120 2023-08-25T09:42:52.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68013640 con 0x7f6a7014a120 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.058+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a701dc080 con 0x7f6a7014a120 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.059+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a701dc640 con 0x7f6a7014a120 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.059+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7004dc40 con 0x7f6a7014a120 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.060+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a680137a0 con 0x7f6a7014a120 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.060+0000 7f6a6cff9640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6a5c06a050 0x7f6a5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.060+0000 7f6a6ffff640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6a5c06a050 0x7f6a5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.060+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a680888d0 con 0x7f6a7014a120 2023-08-25T09:42:52.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.061+0000 7f6a6ffff640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6a5c06a050 0x7f6a5c06c510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a600017e0 tx=0x7f6a60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:52.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.064+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a68054070 con 0x7f6a7014a120 2023-08-25T09:42:52.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.295+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6a7006e660 con 0x7f6a7014a120 2023-08-25T09:42:52.303 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.299+0000 7f6a6cff9640 1 -- 172.21.15.89:0/3349935706 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6a68057690 con 0x7f6a7014a120 2023-08-25T09:42:52.304 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-08-25T09:42:52.304 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAvd+hkle7ZGxAAQN9Z+CBij65mSNnJP4/B3g== 2023-08-25T09:42:52.305 INFO:teuthology.orchestra.run.smithi089.stdout: caps mds = "allow" 2023-08-25T09:42:52.305 INFO:teuthology.orchestra.run.smithi089.stdout: caps mon = "allow r" 2023-08-25T09:42:52.305 INFO:teuthology.orchestra.run.smithi089.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T09:42:52.308 INFO:teuthology.orchestra.run.smithi089.stderr:updated caps for client.0 2023-08-25T09:42:52.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6a5c06a050 msgr2=0x7f6a5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6a5c06a050 0x7f6a5c06c510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a600017e0 tx=0x7f6a60009040 comp rx=0 tx=0).stop 2023-08-25T09:42:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 msgr2=0x7f6a701382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 0x7f6a701382c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6a7006a910 tx=0x7f6a6800e530 comp rx=0 tx=0).stop 2023-08-25T09:42:52.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 shutdown_connections 2023-08-25T09:42:52.310 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f6a5c06a050 0x7f6a5c06c510 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a7014a120 0x7f6a701382c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a701db940 0x7f6a70149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 --2- 172.21.15.89:0/3349935706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a58003f20 0x7f6a700ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 >> 172.21.15.89:0/3349935706 conn(0x7f6a700bbe80 msgr2=0x7f6a7013dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 shutdown_connections 2023-08-25T09:42:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.301+0000 7f6a76883640 1 -- 172.21.15.89:0/3349935706 wait complete. 2023-08-25T09:42:52.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T09:42:52.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.412+0000 7fb871942640 1 Processor -- start 2023-08-25T09:42:52.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.412+0000 7fb871942640 1 -- start start 2023-08-25T09:42:52.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.412+0000 7fb871942640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 0x7fb86c1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.412+0000 7fb871942640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c0b7c20 con 0x7fb86c0b3250 2023-08-25T09:42:52.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.412+0000 7fb871942640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c0ba970 con 0x7fb86c0b9ac0 2023-08-25T09:42:52.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.412+0000 7fb871942640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0b3eb0 con 0x7fb86c0ba500 2023-08-25T09:42:52.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb86c0b3250 0x7fb86c0b90a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40780/0 (socket says 172.21.15.89:40780) 2023-08-25T09:42:52.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86affd640 1 -- 172.21.15.89:0/3976133567 learned_addr learned my addr 172.21.15.89:0/3976133567 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:42:52.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437887221 0 0) 0x7fb86c0b7c20 con 0x7fb86c0b3250 2023-08-25T09:42:52.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb858003520 con 0x7fb86c0b3250 2023-08-25T09:42:52.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86b7fe640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 0x7fb86c1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286065055 0 0) 0x7fb858003520 con 0x7fb86c0b3250 2023-08-25T09:42:52.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 msgr2=0x7fb86c1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:52.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 0x7fb86c1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 >> v1:172.21.15.121:6789/0 conn(0x7fb86c0b9ac0 legacy=0x7fb86c148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c148820 con 0x7fb86c0b3250 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7fb85c001670 con 0x7fb86c0b3250 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 >> v1:172.21.15.89:6789/0 conn(0x7fb86c0b3250 legacy=0x7fb86c0b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb858003a10 0x7fb858003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8580047c0 0x7fb858004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 0x7fb858005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85800ba50 con 0x7fb8580047c0 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85800bbc0 con 0x7fb858003a10 2023-08-25T09:42:52.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85800bd80 con 0x7fb86c0ba500 2023-08-25T09:42:52.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb863fff640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8580047c0 0x7fb858004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86affd640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb858003a10 0x7fb858003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.413+0000 7fb86b7fe640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 0x7fb858005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb863fff640 1 -- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 msgr2=0x7fb858005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:52.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb863fff640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c0ba500 0x7fb858005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb863fff640 1 -- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb858003a10 msgr2=0x7fb858003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:52.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb863fff640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb858003a10 0x7fb858003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb863fff640 1 -- 172.21.15.89:0/3976133567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858003520 con 0x7fb8580047c0 2023-08-25T09:42:52.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb863fff640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8580047c0 0x7fb858004c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb854001750 tx=0x7fb8580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4106db594e6f091 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:52.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8540052d0 con 0x7fb8580047c0 2023-08-25T09:42:52.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85402e050 con 0x7fb8580047c0 2023-08-25T09:42:52.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.414+0000 7fb86a7fc640 1 -- 172.21.15.89:0/3976133567 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8540035f0 con 0x7fb8580047c0 2023-08-25T09:42:52.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb871942640 1 -- 172.21.15.89:0/3976133567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8580047c0 msgr2=0x7fb858004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb871942640 1 --2- 172.21.15.89:0/3976133567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8580047c0 0x7fb858004c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb854001750 tx=0x7fb8580057f0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb86b7fe640 1 -- 172.21.15.89:0/3976133567 reap_dead start 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb871942640 1 -- 172.21.15.89:0/3976133567 shutdown_connections 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb871942640 1 -- 172.21.15.89:0/3976133567 >> 172.21.15.89:0/3976133567 conn(0x7fb86c0bab60 msgr2=0x7fb86c0baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb871942640 1 -- 172.21.15.89:0/3976133567 shutdown_connections 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.415+0000 7fb871942640 1 -- 172.21.15.89:0/3976133567 wait complete. 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.416+0000 7fb871942640 1 Processor -- start 2023-08-25T09:42:52.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.416+0000 7fb871942640 1 -- start start 2023-08-25T09:42:52.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb871942640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8580047c0 0x7fb86c147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb871942640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 0x7fb86c145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb871942640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c1e0e00 0x7fb86c1e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb871942640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c146490 con 0x7fb86c145a20 2023-08-25T09:42:52.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb871942640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c1481d0 con 0x7fb8580047c0 2023-08-25T09:42:52.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb871942640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0b6c90 con 0x7fb86c1e0e00 2023-08-25T09:42:52.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 0x7fb86c145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 0x7fb86c145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35280/0 (socket says 172.21.15.89:35280) 2023-08-25T09:42:52.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 -- 172.21.15.89:0/4115132452 learned_addr learned my addr 172.21.15.89:0/4115132452 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:52.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb86b7fe640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c1e0e00 0x7fb86c1e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb86affd640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8580047c0 0x7fb86c147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 -- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c1e0e00 msgr2=0x7fb86c1e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c1e0e00 0x7fb86c1e1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 -- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8580047c0 msgr2=0x7fb86c147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8580047c0 0x7fb86c147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 -- 172.21.15.89:0/4115132452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c1e17c0 con 0x7fb86c145a20 2023-08-25T09:42:52.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb863fff640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 0x7fb86c145e80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb854005040 tx=0x7fb854001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:52.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8540076c0 con 0x7fb86c145a20 2023-08-25T09:42:52.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854007a30 con 0x7fb86c145a20 2023-08-25T09:42:52.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.417+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854006c20 con 0x7fb86c145a20 2023-08-25T09:42:52.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.418+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c0b65d0 con 0x7fb86c145a20 2023-08-25T09:42:52.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.418+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c147500 con 0x7fb86c145a20 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.419+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c0b6430 con 0x7fb86c145a20 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.419+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8540035f0 con 0x7fb86c145a20 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.419+0000 7fb868ff9640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb84c06a050 0x7fb84c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.420+0000 7fb86affd640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb84c06a050 0x7fb84c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.420+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8540aa160 con 0x7fb86c145a20 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.420+0000 7fb86affd640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb84c06a050 0x7fb84c06c510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb85c001050 tx=0x7fb85c001bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:52.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.424+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb86c0b6430 con 0x7fb86c145a20 2023-08-25T09:42:52.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.628+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb86c0b6dd0 con 0x7fb86c145a20 2023-08-25T09:42:52.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.628+0000 7fb868ff9640 1 -- 172.21.15.89:0/4115132452 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4082 (secure 0 0 0) 0x7fb86c0b6dd0 con 0x7fb86c145a20 2023-08-25T09:42:52.632 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:42:52.632 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/271285710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":271285710},{"type":"v1","addr":"172.21.15.121:6833","nonce":271285710}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2463890868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2463890868},{"type":"v1","addr":"172.21.15.89:6835","nonce":2463890868}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T09:42:43.602424+0000","modified":"2023-08-25T09:42:46.272118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6837/3523672662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3523672662},{"type":"v1","addr":"172.21.15.89:6837","nonce":3523672662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T09:42:52.634 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 12 2023-08-25T09:42:52.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb84c06a050 msgr2=0x7fb84c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb84c06a050 0x7fb84c06c510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb85c001050 tx=0x7fb85c001bf0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 msgr2=0x7fb86c145e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:52.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 0x7fb86c145e80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb854005040 tx=0x7fb854001120 comp rx=0 tx=0).stop 2023-08-25T09:42:52.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 shutdown_connections 2023-08-25T09:42:52.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fb84c06a050 0x7fb84c06c510 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c145a20 0x7fb86c145e80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb86c1e0e00 0x7fb86c1e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 --2- 172.21.15.89:0/4115132452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8580047c0 0x7fb86c147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:52.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 >> 172.21.15.89:0/4115132452 conn(0x7fb86c0bab60 msgr2=0x7fb86c070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:52.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 shutdown_connections 2023-08-25T09:42:52.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:52.630+0000 7fb871942640 1 -- 172.21.15.89:0/4115132452 wait complete. 2023-08-25T09:42:52.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T09:42:43.602424+0000', 'modified': '2023-08-25T09:42:46.272118+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5067}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5067': {'gid': 5067, 'name': 'a', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6837/3523672662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 3523672662}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 3523672662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T09:42:52.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T09:42:52.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-25T09:42:53.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.047+0000 7f55a3196640 1 Processor -- start 2023-08-25T09:42:53.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.047+0000 7f55a3196640 1 -- start start 2023-08-25T09:42:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a3196640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c146f60 0x7f559c070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a3196640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f559c0b2e20 0x7f559c06f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a3196640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c070a40 con 0x7f559c070120 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a3196640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c06ec00 con 0x7f559c0b2e20 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a3196640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06f560 con 0x7f559c146f60 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f559c0b2e20 0x7f559c06f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f559c0b2e20 0x7f559c06f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35282/0 (socket says 172.21.15.89:35282) 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 -- 172.21.15.89:0/3097247957 learned_addr learned my addr 172.21.15.89:0/3097247957 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f559bfff640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c146f60 0x7f559c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 -- 172.21.15.89:0/3097247957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c146f60 msgr2=0x7f559c070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c146f60 0x7f559c070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 -- 172.21.15.89:0/3097247957 >> v1:172.21.15.121:6789/0 conn(0x7f559c070120 legacy=0x7f559c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f55a1733640 1 -- 172.21.15.89:0/3097247957 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0b3530 con 0x7f559c0b2e20 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.048+0000 7f559bfff640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c146f60 0x7f559c070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a1733640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0b2e20 0x7f559c06f020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5594009e50 tx=0x7f559402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b667ddbbe08014b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f559b7fe640 1 -- 172.21.15.89:0/3097247957 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559402c9e0 con 0x7f559c0b2e20 2023-08-25T09:42:53.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f559b7fe640 1 -- 172.21.15.89:0/3097247957 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559402cb40 con 0x7f559c0b2e20 2023-08-25T09:42:53.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f559b7fe640 1 -- 172.21.15.89:0/3097247957 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940343f0 con 0x7f559c0b2e20 2023-08-25T09:42:53.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a3196640 1 -- 172.21.15.89:0/3097247957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0b2e20 msgr2=0x7f559c06f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a3196640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0b2e20 0x7f559c06f020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5594009e50 tx=0x7f559402be40 comp rx=0 tx=0).stop 2023-08-25T09:42:53.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a3196640 1 -- 172.21.15.89:0/3097247957 shutdown_connections 2023-08-25T09:42:53.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a3196640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c0b2e20 0x7f559c06f020 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a3196640 1 --2- 172.21.15.89:0/3097247957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c146f60 0x7f559c070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.049+0000 7f55a3196640 1 -- 172.21.15.89:0/3097247957 >> 172.21.15.89:0/3097247957 conn(0x7f559c069a30 msgr2=0x7f559c069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.050+0000 7f55a3196640 1 -- 172.21.15.89:0/3097247957 shutdown_connections 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.050+0000 7f55a3196640 1 -- 172.21.15.89:0/3097247957 wait complete. 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.050+0000 7f55a3196640 1 Processor -- start 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 -- start start 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c070120 0x7f559c1dda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f559c0b2e20 0x7f559c13d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 0x7f559c13aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c13db70 con 0x7f559c146f60 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1e16c0 con 0x7f559c0b2e20 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a3196640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c141b70 con 0x7f559c070120 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a1733640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 0x7f559c13aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a1733640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 0x7f559c13aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35298/0 (socket says 172.21.15.89:35298) 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.051+0000 7f55a1733640 1 -- 172.21.15.89:0/2052313144 learned_addr learned my addr 172.21.15.89:0/2052313144 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a0f32640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c070120 0x7f559c1dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f559bfff640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f559c0b2e20 0x7f559c13d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a1733640 1 -- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c070120 msgr2=0x7f559c1dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a1733640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c070120 0x7f559c1dda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a1733640 1 -- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f559c0b2e20 msgr2=0x7f559c13d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a1733640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f559c0b2e20 0x7f559c13d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a1733640 1 -- 172.21.15.89:0/2052313144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594009b30 con 0x7f559c146f60 2023-08-25T09:42:53.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a1733640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 0x7f559c13aea0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5594036040 tx=0x7f5594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55997fa640 1 -- 172.21.15.89:0/2052313144 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559403e450 con 0x7f559c146f60 2023-08-25T09:42:53.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55997fa640 1 -- 172.21.15.89:0/2052313144 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559403e5d0 con 0x7f559c146f60 2023-08-25T09:42:53.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c1e10b0 con 0x7f559c146f60 2023-08-25T09:42:53.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55997fa640 1 -- 172.21.15.89:0/2052313144 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559403e980 con 0x7f559c146f60 2023-08-25T09:42:53.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.052+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c1417f0 con 0x7f559c146f60 2023-08-25T09:42:53.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.053+0000 7f55997fa640 1 -- 172.21.15.89:0/2052313144 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f559403eae0 con 0x7f559c146f60 2023-08-25T09:42:53.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.054+0000 7f55997fa640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f558006a050 0x7f558006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.054+0000 7f55997fa640 1 -- 172.21.15.89:0/2052313144 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55940ab1f0 con 0x7f559c146f60 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.054+0000 7f55a0f32640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f558006a050 0x7f558006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.054+0000 7f55a0f32640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f558006a050 0x7f558006c510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5590003d90 tx=0x7f5590009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 Processor -- start 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 -- start start 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1082110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d1082650 0x5594d10b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d0ff4230 con 0x5594d10be230 2023-08-25T09:42:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d0ff1920 con 0x5594d1082650 2023-08-25T09:42:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.055+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594d0fed210 con 0x5594d10b3a30 2023-08-25T09:42:53.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1082110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1082110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35312/0 (socket says 172.21.15.89:35312) 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 -- 172.21.15.89:0/1670057854 learned_addr learned my addr 172.21.15.89:0/1670057854 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a1733640 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f559bfff640 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d1082650 0x5594d10b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 -- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 msgr2=0x5594d10c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 -- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d1082650 msgr2=0x5594d10b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d1082650 0x5594d10b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 -- 172.21.15.89:0/1670057854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594d0ff1e80 con 0x5594d10be230 2023-08-25T09:42:53.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55a0f32640 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1082110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f559000d8e0 tx=0x7f5590010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afb06af20fdd5b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55867fc640 1 -- 172.21.15.89:0/1670057854 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590014db0 con 0x5594d10be230 2023-08-25T09:42:53.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55867fc640 1 -- 172.21.15.89:0/1670057854 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559000de60 con 0x5594d10be230 2023-08-25T09:42:53.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.056+0000 7f55867fc640 1 -- 172.21.15.89:0/1670057854 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559001f640 con 0x5594d10be230 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 -- 172.21.15.89:0/1670057854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 msgr2=0x5594d1082110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1082110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f559000d8e0 tx=0x7f5590010000 comp rx=0 tx=0).stop 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 -- 172.21.15.89:0/1670057854 shutdown_connections 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d1082650 0x5594d10b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1670057854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1082110 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 -- 172.21.15.89:0/1670057854 >> 172.21.15.89:0/1670057854 conn(0x5594d1083d90 msgr2=0x5594d10bd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 -- 172.21.15.89:0/1670057854 shutdown_connections 2023-08-25T09:42:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 -- 172.21.15.89:0/1670057854 wait complete. 2023-08-25T09:42:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 -- start start 2023-08-25T09:42:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.057+0000 7f55a5de6740 1 Processor -- start 2023-08-25T09:42:53.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10be230 0x5594d10abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d0f8cbc0 con 0x5594d10b04c0 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d0f8c860 con 0x5594d10be230 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594d0f6f2a0 con 0x5594d10b3a30 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a5de6740 10 client.0 _ll_register_callbacks cb 0x5594d0fa52e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T09:42:53.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35318/0 (socket says 172.21.15.89:35318) 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 -- 172.21.15.89:0/1168998231 learned_addr learned my addr 172.21.15.89:0/1168998231 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a0f32640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f559bfff640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10be230 0x5594d10abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 -- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 msgr2=0x5594d10d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 -- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10be230 msgr2=0x5594d10abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10be230 0x5594d10abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 -- 172.21.15.89:0/1168998231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559000d5c0 con 0x5594d10b04c0 2023-08-25T09:42:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f55a1733640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10ac2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f55940a9670 tx=0x7f559407a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f480d9e51cc2f821 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.058+0000 7f557b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-08-25T09:42:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f557b7fe640 1 -- 172.21.15.89:0/1168998231 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594082460 con 0x5594d10b04c0 2023-08-25T09:42:53.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f557b7fe640 1 -- 172.21.15.89:0/1168998231 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f559407e120 con 0x5594d10b04c0 2023-08-25T09:42:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594d1014b90 con 0x5594d10b04c0 2023-08-25T09:42:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f557b7fe640 1 -- 172.21.15.89:0/1168998231 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f559407e2e0 con 0x5594d10b04c0 2023-08-25T09:42:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 10 client.5271 fetch_fsmap learned FSMap version 12 2023-08-25T09:42:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5594d0feb890 con 0x5594d10b04c0 2023-08-25T09:42:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f557b7fe640 1 -- 172.21.15.89:0/1168998231 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594d1014b90 con 0x5594d10b04c0 2023-08-25T09:42:53.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f557b7fe640 1 -- 172.21.15.89:0/1168998231 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 12) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f559404f020 con 0x5594d10b04c0 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 10 client.5271 fetch_fsmap finished waiting for FSMap version 12 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 10 client.5271 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 20 client.5271 populate_metadata read hostname 'smithi089' 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d10ae290 0x5594d10ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 4 client.5271 mds_command: new command op to 5067 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 --> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594d0fc1a90 con 0x5594d10ae290 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f55a0f32640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d10ae290 0x5594d10ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.059+0000 7f557b7fe640 10 client.5271 ms_handle_connect on v2:172.21.15.89:6836/3523672662 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a0f32640 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d10ae290 0x5594d10ae670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e5cee5154d5969 server_cookie=3d8e0db6fc155e56 in_seq=0 out_seq=0 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f557b7fe640 1 -- 172.21.15.89:0/1168998231 <== mds.0 v2:172.21.15.89:6836/3523672662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594d0fc1a90 con 0x5594d10ae290 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f557b7fe640 10 client.5271 handle_command_reply: tid=0 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 client.5271 shutdown 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 msgr2=0x5594d10ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10ac2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f55940a9670 tx=0x7f559407a170 comp rx=0 tx=0).stop 2023-08-25T09:42:53.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 shutdown_connections 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d10ae290 0x5594d10ae670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10ac2d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10be230 0x5594d10abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f557b7fe640 0 client.5271 ms_handle_reset on v2:172.21.15.89:6836/3523672662 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 --2- 172.21.15.89:0/1168998231 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 >> 172.21.15.89:0/1168998231 conn(0x5594d1082650 msgr2=0x5594d10b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 shutdown_connections 2023-08-25T09:42:53.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.060+0000 7f55a5de6740 1 -- 172.21.15.89:0/1168998231 wait complete. 2023-08-25T09:42:53.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.061+0000 7f55a5de6740 20 client.5271 trim_cache size 0 max 16384 2023-08-25T09:42:53.085 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 Processor -- start 2023-08-25T09:42:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 -- start start 2023-08-25T09:42:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b3a30 0x5594d1081ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10be230 0x5594d1080c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d10b53d0 con 0x5594d10b04c0 2023-08-25T09:42:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d107df00 con 0x5594d10b3a30 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594d1014b90 con 0x5594d10be230 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a0f32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a0f32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35334/0 (socket says 172.21.15.89:35334) 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.076+0000 7f55a0f32640 1 -- 172.21.15.89:0/910802928 learned_addr learned my addr 172.21.15.89:0/910802928 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a0f32640 1 -- 172.21.15.89:0/910802928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10be230 msgr2=0x5594d1080c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a0f32640 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10be230 0x5594d1080c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.087 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a0f32640 1 -- 172.21.15.89:0/910802928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b3a30 msgr2=0x5594d1081ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a0f32640 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b3a30 0x5594d1081ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a0f32640 1 -- 172.21.15.89:0/910802928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594d0f8bb90 con 0x5594d10b04c0 2023-08-25T09:42:53.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a0f32640 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10b5590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5590009010 tx=0x7f559001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c5ba96e3a39e12 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.095 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f5586ffd640 1 -- 172.21.15.89:0/910802928 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590030070 con 0x5594d10b04c0 2023-08-25T09:42:53.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f5586ffd640 1 -- 172.21.15.89:0/910802928 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590014d30 con 0x5594d10b04c0 2023-08-25T09:42:53.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f5586ffd640 1 -- 172.21.15.89:0/910802928 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590014ea0 con 0x5594d10b04c0 2023-08-25T09:42:53.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 -- 172.21.15.89:0/910802928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 msgr2=0x5594d10b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10b5590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5590009010 tx=0x7f559001c000 comp rx=0 tx=0).stop 2023-08-25T09:42:53.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 -- 172.21.15.89:0/910802928 shutdown_connections 2023-08-25T09:42:53.096 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10be230 0x5594d1080c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b3a30 0x5594d1081ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 --2- 172.21.15.89:0/910802928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10b04c0 0x5594d10b5590 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 -- 172.21.15.89:0/910802928 >> 172.21.15.89:0/910802928 conn(0x5594d1082650 msgr2=0x5594d10e1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 -- 172.21.15.89:0/910802928 shutdown_connections 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.077+0000 7f55a5de6740 1 -- 172.21.15.89:0/910802928 wait complete. 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.078+0000 7f55a5de6740 1 -- start start 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.078+0000 7f55a5de6740 1 Processor -- start 2023-08-25T09:42:53.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b04c0 0x5594d10ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1120ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d10d36d0 con 0x5594d10be230 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594d10d3280 con 0x5594d10b04c0 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594d10d2df0 con 0x5594d10b3a30 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 10 client.0 _ll_register_callbacks cb 0x7f5590003a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T09:42:53.098 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1120ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1120ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35350/0 (socket says 172.21.15.89:35350) 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 -- 172.21.15.89:0/620934460 learned_addr learned my addr 172.21.15.89:0/620934460 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f559bfff640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a0f32640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b04c0 0x5594d10ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 -- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 msgr2=0x5594d10d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 -- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b04c0 msgr2=0x5594d10ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b04c0 0x5594d10ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 -- 172.21.15.89:0/620934460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594d0ff1e80 con 0x5594d10be230 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f559bfff640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a1733640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1120ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f55940a96a0 tx=0x7f559403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354437d1ce4952a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f557b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f557b7fe640 1 -- 172.21.15.89:0/620934460 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594082460 con 0x5594d10be230 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f557b7fe640 1 -- 172.21.15.89:0/620934460 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55940821b0 con 0x5594d10be230 2023-08-25T09:42:53.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f559000de60 con 0x5594d10be230 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.079+0000 7f557b7fe640 1 -- 172.21.15.89:0/620934460 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5594081fd0 con 0x5594d10be230 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 10 client.5277 fetch_fsmap learned FSMap version 12 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5594d0fb1060 con 0x5594d10be230 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f557b7fe640 1 -- 172.21.15.89:0/620934460 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559000de60 con 0x5594d10be230 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f557b7fe640 1 -- 172.21.15.89:0/620934460 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 12) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f559404f070 con 0x5594d10be230 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 10 client.5277 fetch_fsmap finished waiting for FSMap version 12 2023-08-25T09:42:53.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 10 client.5277 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 20 client.5277 populate_metadata read hostname 'smithi089' 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d1120ff0 0x5594d10858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 4 client.5277 mds_command: new command op to 5067 tid=0[{"prefix": "status"}] 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 --> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5594d0fe61f0 con 0x5594d1120ff0 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a0f32640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d1120ff0 0x5594d10858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f557b7fe640 10 client.5277 ms_handle_connect on v2:172.21.15.89:6836/3523672662 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a0f32640 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d1120ff0 0x5594d10858b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69163694be5bfbd server_cookie=9bac1f7413dc2067 in_seq=0 out_seq=0 2023-08-25T09:42:53.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f557b7fe640 1 -- 172.21.15.89:0/620934460 <== mds.0 v2:172.21.15.89:6836/3523672662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5594d0fe61f0 con 0x5594d1120ff0 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f557b7fe640 10 client.5277 handle_command_reply: tid=0 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.080+0000 7f55a5de6740 1 client.5277 shutdown 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 msgr2=0x5594d1120ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1120ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f55940a96a0 tx=0x7f559403e000 comp rx=0 tx=0).stop 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 shutdown_connections 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:6836/3523672662,v1:172.21.15.89:6837/3523672662] conn(0x5594d1120ff0 0x5594d10858b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5594d10be230 0x5594d1120ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f557b7fe640 0 client.5277 ms_handle_reset on v2:172.21.15.89:6836/3523672662 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5594d10b3a30 0x5594d10d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 --2- 172.21.15.89:0/620934460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594d10b04c0 0x5594d10ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 >> 172.21.15.89:0/620934460 conn(0x5594d1082650 msgr2=0x5594d1086f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 shutdown_connections 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 1 -- 172.21.15.89:0/620934460 wait complete. 2023-08-25T09:42:53.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a5de6740 20 client.5277 trim_cache size 0 max 16384 2023-08-25T09:42:53.105 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-08-25T09:42:53.105 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "f41429b4-33b6-4950-8ef3-07360119fda9", 2023-08-25T09:42:53.105 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2023-08-25T09:42:53.105 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5067, 2023-08-25T09:42:53.105 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 8.8267514570000003, 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 12, 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 34, 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 34, 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 17.024961660999999 2023-08-25T09:42:53.106 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-08-25T09:42:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f558006a050 msgr2=0x7f558006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f558006a050 0x7f558006c510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5590003d90 tx=0x7f5590009040 comp rx=0 tx=0).stop 2023-08-25T09:42:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 msgr2=0x7f559c13aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 0x7f559c13aea0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5594036040 tx=0x7f5594004a40 comp rx=0 tx=0).stop 2023-08-25T09:42:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 shutdown_connections 2023-08-25T09:42:53.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f558006a050 0x7f558006c510 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f559c146f60 0x7f559c13aea0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f559c0b2e20 0x7f559c13d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 --2- 172.21.15.89:0/2052313144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f559c070120 0x7f559c1dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 >> 172.21.15.89:0/2052313144 conn(0x7f559c069a30 msgr2=0x7f559c1409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 shutdown_connections 2023-08-25T09:42:53.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.081+0000 7f55a3196640 1 -- 172.21.15.89:0/2052313144 wait complete. 2023-08-25T09:42:53.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T09:42:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.205+0000 7f8cd2399640 1 Processor -- start 2023-08-25T09:42:53.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.205+0000 7f8cd2399640 1 -- start start 2023-08-25T09:42:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8cd2399640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 0x7f8ccc0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8cd2399640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ccc14ddb0 0x7f8ccc14e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8cd2399640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc145020 con 0x7f8ccc0b6ec0 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8cd2399640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b9330 con 0x7f8ccc14ddb0 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8cd2399640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b7d70 con 0x7f8ccc144c40 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8ccbfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 0x7f8ccc0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8ccbfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 0x7f8ccc0bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43866/0 (socket says 172.21.15.89:43866) 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8cd0936640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ccc14ddb0 0x7f8ccc14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.206+0000 7f8ccbfff640 1 -- 172.21.15.89:0/84623296 learned_addr learned my addr 172.21.15.89:0/84623296 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.207+0000 7f8ccbfff640 1 -- 172.21.15.89:0/84623296 >> v2:172.21.15.121:3300/0 conn(0x7f8ccc14ddb0 msgr2=0x7f8ccc14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:42:53.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.207+0000 7f8ccbfff640 1 --2- 172.21.15.89:0/84623296 >> v2:172.21.15.121:3300/0 conn(0x7f8ccc14ddb0 0x7f8ccc14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.207+0000 7f8ccbfff640 1 -- 172.21.15.89:0/84623296 >> v1:172.21.15.121:6789/0 conn(0x7f8ccc0b6ec0 legacy=0x7f8ccc0b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.207+0000 7f8ccbfff640 1 -- 172.21.15.89:0/84623296 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0bd290 con 0x7f8ccc144c40 2023-08-25T09:42:53.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.207+0000 7f8ccbfff640 1 --2- 172.21.15.89:0/84623296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 0x7f8ccc0bcc70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009870 tx=0x7f8cbc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a5b5052f8b4b01 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8ccaffd640 1 -- 172.21.15.89:0/84623296 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc030840 con 0x7f8ccc144c40 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8ccaffd640 1 -- 172.21.15.89:0/84623296 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc0309a0 con 0x7f8ccc144c40 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8ccaffd640 1 -- 172.21.15.89:0/84623296 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc030d30 con 0x7f8ccc144c40 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 -- 172.21.15.89:0/84623296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 msgr2=0x7f8ccc0bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 --2- 172.21.15.89:0/84623296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 0x7f8ccc0bcc70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009870 tx=0x7f8cbc02b980 comp rx=0 tx=0).stop 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 -- 172.21.15.89:0/84623296 shutdown_connections 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 --2- 172.21.15.89:0/84623296 >> v2:172.21.15.121:3300/0 conn(0x7f8ccc14ddb0 0x7f8ccc14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 --2- 172.21.15.89:0/84623296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc144c40 0x7f8ccc0bcc70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 -- 172.21.15.89:0/84623296 >> 172.21.15.89:0/84623296 conn(0x7f8ccc0654f0 msgr2=0x7f8ccc0658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 -- 172.21.15.89:0/84623296 shutdown_connections 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.208+0000 7f8cd2399640 1 -- 172.21.15.89:0/84623296 wait complete. 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.209+0000 7f8cd2399640 1 Processor -- start 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.209+0000 7f8cd2399640 1 -- start start 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd2399640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc0b6ec0 0x7f8ccc0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd2399640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 0x7f8ccc1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.215 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd2399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ccc14ddb0 0x7f8ccc149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd2399640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b6950 con 0x7f8ccc144c40 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd2399640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b6c80 con 0x7f8ccc14ddb0 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd2399640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc148e30 con 0x7f8ccc0b6ec0 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 0x7f8ccc1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 0x7f8ccc1492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35356/0 (socket says 172.21.15.89:35356) 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 -- 172.21.15.89:0/650601423 learned_addr learned my addr 172.21.15.89:0/650601423 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccbfff640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc0b6ec0 0x7f8ccc0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd0936640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ccc14ddb0 0x7f8ccc149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 -- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc0b6ec0 msgr2=0x7f8ccc0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc0b6ec0 0x7f8ccc0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 -- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ccc14ddb0 msgr2=0x7f8ccc149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ccc14ddb0 0x7f8ccc149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8ccb7fe640 1 -- 172.21.15.89:0/650601423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0094d0 con 0x7f8ccc144c40 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.210+0000 7f8cd0936640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ccc14ddb0 0x7f8ccc149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T09:42:53.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.211+0000 7f8ccb7fe640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 0x7f8ccc1492c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c430 tx=0x7f8cc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.211+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00052d0 con 0x7f8ccc144c40 2023-08-25T09:42:53.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.211+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0005430 con 0x7f8ccc144c40 2023-08-25T09:42:53.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.211+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc14ada0 con 0x7f8ccc144c40 2023-08-25T09:42:53.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.211+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0003830 con 0x7f8ccc144c40 2023-08-25T09:42:53.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.211+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc14a020 con 0x7f8ccc144c40 2023-08-25T09:42:53.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.212+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc1488f0 con 0x7f8ccc144c40 2023-08-25T09:42:53.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.212+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8cc0003990 con 0x7f8ccc144c40 2023-08-25T09:42:53.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.212+0000 7f8cc8ff9640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8cb806a050 0x7f8cb806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:42:53.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.212+0000 7f8ccbfff640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8cb806a050 0x7f8cb806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:42:53.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.213+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cc0087b40 con 0x7f8ccc144c40 2023-08-25T09:42:53.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.213+0000 7f8ccbfff640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8cb806a050 0x7f8cb806c510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc036000 tx=0x7f8cbc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:42:53.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.217+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8cc0053240 con 0x7f8ccc144c40 2023-08-25T09:42:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.418+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ccc073bf0 con 0x7f8ccc144c40 2023-08-25T09:42:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.418+0000 7f8cc8ff9640 1 -- 172.21.15.89:0/650601423 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8cc0056860 con 0x7f8ccc144c40 2023-08-25T09:42:53.421 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T09:42:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8cb806a050 msgr2=0x7f8cb806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8cb806a050 0x7f8cb806c510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc036000 tx=0x7f8cbc008030 comp rx=0 tx=0).stop 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 msgr2=0x7f8ccc1492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 0x7f8ccc1492c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c430 tx=0x7f8cc000c8f0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 shutdown_connections 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f8cb806a050 0x7f8cb806c510 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ccc144c40 0x7f8ccc1492c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ccc14ddb0 0x7f8ccc149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 --2- 172.21.15.89:0/650601423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ccc0b6ec0 0x7f8ccc0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:42:53.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 >> 172.21.15.89:0/650601423 conn(0x7f8ccc0654f0 msgr2=0x7f8ccc0658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:42:53.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 shutdown_connections 2023-08-25T09:42:53.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:42:53.420+0000 7f8cd2399640 1 -- 172.21.15.89:0/650601423 wait complete. 2023-08-25T09:42:53.433 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T09:42:53.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T09:42:53.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-08-25T09:42:53.435 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T09:42:53.435 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:53.436 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T09:42:53.436 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T09:42:53.436 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T09:42:53.436 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T09:42:53.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:53.437 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-08-25T09:42:53.499 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T09:42:53.499 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T09:42:53.499 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T09:42:53.500 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:53.500 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-08-25T09:42:53.500 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:53.500 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T09:42:53.500 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:53.501 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2023-08-25T09:42:53.501 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T09:42:53.501 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:53.501 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2023-08-25T09:42:53.501 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T09:42:53.501 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:53.502 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T09:42:53.502 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:53.502 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T09:42:53.502 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42282sec preferred_lft 42282sec 2023-08-25T09:42:53.502 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2023-08-25T09:42:53.502 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:53.503 INFO:teuthology.orchestra.run.smithi149.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T09:42:53.503 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 96:a7:62:db:92:50 brd ff:ff:ff:ff:ff:ff 2023-08-25T09:42:53.503 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T09:42:53.504 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:53.504 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::dcf1:1dff:fe6c:f0eb/64 scope link 2023-08-25T09:42:53.504 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:53.505 INFO:teuthology.orchestra.run.smithi149.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T09:42:53.505 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 96:a7:62:db:92:50 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T09:42:53.505 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::94a7:62ff:fedb:9250/64 scope link 2023-08-25T09:42:53.505 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-08-25T09:42:53.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:53.506 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T09:42:53.597 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-08-25T09:42:53.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:53.602 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-08-25T09:42:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-08-25T09:42:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T09:42:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T09:42:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T09:42:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T09:42:53.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:53.657 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-08-25T09:42:53.657 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-08-25T09:42:53.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T09:42:53.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T09:42:53.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T09:42:53.659 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-08-25T09:42:53.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:53.847 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-08-25T09:42:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T09:42:53.898 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T09:42:53.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:53.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-08-25T09:42:53.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T09:42:53.994 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T09:42:54.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T09:42:54.053 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:54.104 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-25T09:42:54.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:54.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T09:42:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-08-25T09:42:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T09:42:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-08-25T09:42:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.121:3300,172.21.15.121:3301" 2023-08-25T09:42:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T09:42:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-25T09:42:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-25T09:42:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-08-25T09:42:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.121:3300,172.21.15.121:3301" 2023-08-25T09:42:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-25T09:42:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.121:6789,172.21.15.121:6790" 2023-08-25T09:42:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.121:6789,172.21.15.121:6790:/ 2023-08-25T09:42:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f41429b4-33b6-4950-8ef3-07360119fda9" will pass to kernel 2023-08-25T09:42:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-08-25T09:42:54.293 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2023-08-25T09:42:54.293 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-08-25T09:42:54.293 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2023-08-25T09:42:54.293 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-08-25T09:42:54.295 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T09:42:54.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:54.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T09:42:54.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:54.390 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T09:42:54.458 INFO:teuthology.orchestra.run.smithi149.stdout:client4736 2023-08-25T09:42:54.459 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:42:54.459 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T09:42:54.511 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=xfstests-dev 2023-08-25T09:42:54.554 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.pUGqPxeVwnxfstests-dev 2023-08-25T09:42:54.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:54.554 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.pUGqPxeVwnxfstests-dev) 2023-08-25T09:42:54.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:54.699 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.pUGqPxeVwnxfstests-dev) 2023-08-25T09:42:54.757 INFO:teuthology.orchestra.run.smithi149.stderr:Cloning into '/tmp/tmp.pUGqPxeVwnxfstests-dev'... 2023-08-25T09:42:55.807 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=xfsprogs-dev 2023-08-25T09:42:55.860 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.M8BcpFRYQBxfsprogs-dev 2023-08-25T09:42:55.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:55.862 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.M8BcpFRYQBxfsprogs-dev) 2023-08-25T09:42:55.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:55.961 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.M8BcpFRYQBxfsprogs-dev) 2023-08-25T09:42:56.021 INFO:teuthology.orchestra.run.smithi149.stderr:Cloning into '/tmp/tmp.M8BcpFRYQBxfsprogs-dev'... 2023-08-25T09:42:56.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:56.627 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-08-25T09:42:56.688 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=test 2023-08-25T09:42:56.742 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.Wj7ZcASf2Mtest 2023-08-25T09:42:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T09:42:56.744 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-08-25T09:42:56.802 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=scratch 2023-08-25T09:42:56.858 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.CbXXksMJn5scratch 2023-08-25T09:42:56.859 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-08-25T09:42:56.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-08-25T09:42:57.639 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:34 ago on Fri 25 Aug 2023 09:39:23 AM UTC. 2023-08-25T09:42:57.727 INFO:teuthology.orchestra.run.smithi149.stdout:Package acl-2.3.1-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.727 INFO:teuthology.orchestra.run.smithi149.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.728 INFO:teuthology.orchestra.run.smithi149.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-08-25T09:42:57.729 INFO:teuthology.orchestra.run.smithi149.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-08-25T09:42:57.730 INFO:teuthology.orchestra.run.smithi149.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-08-25T09:42:57.732 INFO:teuthology.orchestra.run.smithi149.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.733 INFO:teuthology.orchestra.run.smithi149.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-08-25T09:42:57.734 INFO:teuthology.orchestra.run.smithi149.stdout:Package gcc-11.3.1-4.3.el9.x86_64 is already installed. 2023-08-25T09:42:57.736 INFO:teuthology.orchestra.run.smithi149.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-08-25T09:42:57.737 INFO:teuthology.orchestra.run.smithi149.stdout:Package lvm2-9:2.03.17-4.el9.x86_64 is already installed. 2023-08-25T09:42:57.738 INFO:teuthology.orchestra.run.smithi149.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-08-25T09:42:57.739 INFO:teuthology.orchestra.run.smithi149.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.739 INFO:teuthology.orchestra.run.smithi149.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-08-25T09:42:57.740 INFO:teuthology.orchestra.run.smithi149.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-08-25T09:42:57.741 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.742 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-08-25T09:42:57.743 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.744 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-08-25T09:42:57.745 INFO:teuthology.orchestra.run.smithi149.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-08-25T09:42:57.746 INFO:teuthology.orchestra.run.smithi149.stdout:Package libuuid-devel-2.37.4-14.el9.x86_64 is already installed. 2023-08-25T09:42:57.747 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-08-25T09:42:57.747 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-3.9.16-1.el9.x86_64 is already installed. 2023-08-25T09:42:57.751 INFO:teuthology.orchestra.run.smithi149.stdout:Package gettext-0.21-7.el9.x86_64 is already installed. 2023-08-25T09:42:57.757 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-08-25T09:42:57.823 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-08-25T09:42:57.828 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-08-25T09:42:57.828 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-08-25T09:42:57.828 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-08-25T09:42:57.828 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-08-25T09:42:57.828 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-devel x86_64 9:1.02.195-3.el9 crb 43 k 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: indent x86_64 2.2.13-2.el9 epel 179 k 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: inih-devel x86_64 49-6.el9 crb 11 k 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: libblkid-devel x86_64 2.37.4-14.el9 CentOS-AppStream 17 k 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: libedit-devel x86_64 3.1-38.20210216cvs.el9 CentOS-AppStream 39 k 2023-08-25T09:42:57.829 INFO:teuthology.orchestra.run.smithi149.stdout: libicu-devel x86_64 67.1-9.el9 CentOS-AppStream 830 k 2023-08-25T09:42:57.830 INFO:teuthology.orchestra.run.smithi149.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-08-25T09:42:57.830 INFO:teuthology.orchestra.run.smithi149.stdout: userspace-rcu-devel x86_64 0.12.1-6.el9 crb 120 k 2023-08-25T09:42:57.830 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-08-25T09:42:57.830 INFO:teuthology.orchestra.run.smithi149.stdout: cpp x86_64 11.4.1-2.1.el9 CentOS-AppStream 11 M 2023-08-25T09:42:57.830 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper x86_64 9:1.02.195-3.el9 CentOS-BaseOS 138 k 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-event x86_64 9:1.02.195-3.el9 CentOS-BaseOS 32 k 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-event-libs x86_64 9:1.02.195-3.el9 CentOS-BaseOS 31 k 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-libs x86_64 9:1.02.195-3.el9 CentOS-BaseOS 177 k 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: gcc x86_64 11.4.1-2.1.el9 CentOS-AppStream 32 M 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: gcc-c++ x86_64 11.4.1-2.1.el9 CentOS-AppStream 13 M 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: gcc-plugin-annobin x86_64 11.4.1-2.1.el9 CentOS-AppStream 49 k 2023-08-25T09:42:57.831 INFO:teuthology.orchestra.run.smithi149.stdout: gettext x86_64 0.21-8.el9 CentOS-BaseOS 1.1 M 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: gettext-libs x86_64 0.21-8.el9 CentOS-BaseOS 302 k 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: libedit x86_64 3.1-38.20210216cvs.el9 CentOS-BaseOS 103 k 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: libgcc x86_64 11.4.1-2.1.el9 CentOS-BaseOS 94 k 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: libgomp x86_64 11.4.1-2.1.el9 CentOS-BaseOS 270 k 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: libstdc++ x86_64 11.4.1-2.1.el9 CentOS-BaseOS 736 k 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: libstdc++-devel x86_64 11.4.1-2.1.el9 CentOS-AppStream 2.2 M 2023-08-25T09:42:57.832 INFO:teuthology.orchestra.run.smithi149.stdout: lvm2 x86_64 9:2.03.21-3.el9 CentOS-BaseOS 1.5 M 2023-08-25T09:42:57.833 INFO:teuthology.orchestra.run.smithi149.stdout: lvm2-libs x86_64 9:2.03.21-3.el9 CentOS-BaseOS 1.0 M 2023-08-25T09:42:57.833 INFO:teuthology.orchestra.run.smithi149.stdout: python-unversioned-command 2023-08-25T09:42:57.833 INFO:teuthology.orchestra.run.smithi149.stdout: noarch 3.9.17-2.el9 CentOS-AppStream 9.0 k 2023-08-25T09:42:57.833 INFO:teuthology.orchestra.run.smithi149.stdout: python3 x86_64 3.9.17-2.el9 CentOS-BaseOS 26 k 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: python3-libs x86_64 3.9.17-2.el9 CentOS-BaseOS 7.3 M 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: systemd x86_64 252-18.el9 CentOS-BaseOS 3.9 M 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-libs x86_64 252-18.el9 CentOS-BaseOS 653 k 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-pam x86_64 252-18.el9 CentOS-BaseOS 261 k 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-rpm-macros noarch 252-18.el9 CentOS-BaseOS 49 k 2023-08-25T09:42:57.834 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-udev x86_64 252-18.el9 CentOS-BaseOS 1.8 M 2023-08-25T09:42:57.835 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-08-25T09:42:57.835 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd x86_64 1.16.0-1.el9 CentOS-AppStream 160 k 2023-08-25T09:42:57.835 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel x86_64 3.5-0.rc1.1.el9 appstream 159 k 2023-08-25T09:42:57.835 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel x86_64 3.5-0.rc1.2.el9 appstream 48 k 2023-08-25T09:42:57.835 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel x86_64 10.40-2.el9 CentOS-AppStream 474 k 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16 x86_64 10.40-2.el9 CentOS-AppStream 215 k 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32 x86_64 10.40-2.el9 CentOS-AppStream 205 k 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-boot-unsigned x86_64 252-17.el9 crb 137 k 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-devel x86_64 252-18.el9 CentOS-AppStream 482 k 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2023-08-25T09:42:57.836 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-08-25T09:42:57.837 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-08-25T09:42:57.837 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-08-25T09:42:57.837 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-08-25T09:42:57.837 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-08-25T09:42:57.838 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-08-25T09:42:57.838 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:42:57.838 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-08-25T09:42:57.838 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2023-08-25T09:42:57.838 INFO:teuthology.orchestra.run.smithi149.stdout:Install 25 Packages 2023-08-25T09:42:57.839 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 26 Packages 2023-08-25T09:42:57.839 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:42:57.839 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 88 M 2023-08-25T09:42:57.839 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-08-25T09:42:58.560 INFO:teuthology.orchestra.run.smithi149.stdout:(1/51): fio-engine-http-3.35-1.el9.x86_64.rpm 76 kB/s | 17 kB 00:00 2023-08-25T09:42:58.584 INFO:teuthology.orchestra.run.smithi149.stdout:(2/51): fio-engine-libaio-3.35-1.el9.x86_64.rpm 59 kB/s | 14 kB 00:00 2023-08-25T09:42:58.668 INFO:teuthology.orchestra.run.smithi149.stdout:(3/51): fio-engine-nbd-3.35-1.el9.x86_64.rpm 126 kB/s | 13 kB 00:00 2023-08-25T09:42:58.693 INFO:teuthology.orchestra.run.smithi149.stdout:(4/51): fio-engine-rados-3.35-1.el9.x86_64.rpm 136 kB/s | 15 kB 00:00 2023-08-25T09:42:58.869 INFO:teuthology.orchestra.run.smithi149.stdout:(5/51): fio-3.35-1.el9.x86_64.rpm 12 MB/s | 6.2 MB 00:00 2023-08-25T09:42:58.894 INFO:teuthology.orchestra.run.smithi149.stdout:(6/51): fio-engine-rbd-3.35-1.el9.x86_64.rpm 85 kB/s | 15 kB 00:00 2023-08-25T09:42:58.919 INFO:teuthology.orchestra.run.smithi149.stdout:(7/51): fio-engine-rdma-3.35-1.el9.x86_64.rpm 97 kB/s | 20 kB 00:00 2023-08-25T09:42:58.961 INFO:teuthology.orchestra.run.smithi149.stdout:(8/51): libblkid-devel-2.37.4-14.el9.x86_64.rpm 417 kB/s | 17 kB 00:00 2023-08-25T09:42:58.996 INFO:teuthology.orchestra.run.smithi149.stdout:(9/51): libedit-devel-3.1-38.20210216cvs.el9.x8 526 kB/s | 39 kB 00:00 2023-08-25T09:42:59.045 INFO:teuthology.orchestra.run.smithi149.stdout:(10/51): libicu-devel-67.1-9.el9.x86_64.rpm 6.6 MB/s | 830 kB 00:00 2023-08-25T09:42:59.096 INFO:teuthology.orchestra.run.smithi149.stdout:(11/51): libnbd-1.16.0-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2023-08-25T09:42:59.137 INFO:teuthology.orchestra.run.smithi149.stdout:(12/51): pcre2-utf16-10.40-2.el9.x86_64.rpm 2.4 MB/s | 215 kB 00:00 2023-08-25T09:42:59.187 INFO:teuthology.orchestra.run.smithi149.stdout:(13/51): pcre2-devel-10.40-2.el9.x86_64.rpm 3.3 MB/s | 474 kB 00:00 2023-08-25T09:42:59.221 INFO:teuthology.orchestra.run.smithi149.stdout:(14/51): pcre2-utf32-10.40-2.el9.x86_64.rpm 1.6 MB/s | 205 kB 00:00 2023-08-25T09:42:59.280 INFO:teuthology.orchestra.run.smithi149.stdout:(15/51): sqlite-3.34.1-6.el9.x86_64.rpm 5.3 MB/s | 747 kB 00:00 2023-08-25T09:42:59.305 INFO:teuthology.orchestra.run.smithi149.stdout:(16/51): rmt-1.6-6.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2023-08-25T09:42:59.534 INFO:teuthology.orchestra.run.smithi149.stdout:(17/51): systemd-devel-252-18.el9.x86_64.rpm 3.8 MB/s | 482 kB 00:00 2023-08-25T09:42:59.535 INFO:teuthology.orchestra.run.smithi149.stdout:(18/51): device-mapper-devel-1.02.195-3.el9.x86 261 kB/s | 43 kB 00:00 2023-08-25T09:42:59.581 INFO:teuthology.orchestra.run.smithi149.stdout:(19/51): libsepol-devel-3.5-0.rc1.2.el9.x86_64. 178 kB/s | 48 kB 00:00 2023-08-25T09:42:59.606 INFO:teuthology.orchestra.run.smithi149.stdout:(20/51): inih-devel-49-6.el9.x86_64.rpm 131 kB/s | 11 kB 00:00 2023-08-25T09:42:59.651 INFO:teuthology.orchestra.run.smithi149.stdout:(21/51): libselinux-devel-3.5-0.rc1.1.el9.x86_6 435 kB/s | 159 kB 00:00 2023-08-25T09:42:59.748 INFO:teuthology.orchestra.run.smithi149.stdout:(22/51): systemd-boot-unsigned-252-17.el9.x86_6 824 kB/s | 137 kB 00:00 2023-08-25T09:42:59.815 INFO:teuthology.orchestra.run.smithi149.stdout:(23/51): userspace-rcu-devel-0.12.1-6.el9.x86_6 578 kB/s | 120 kB 00:00 2023-08-25T09:43:00.116 INFO:teuthology.orchestra.run.smithi149.stdout:(24/51): cpp-11.4.1-2.1.el9.x86_64.rpm 35 MB/s | 11 MB 00:00 2023-08-25T09:43:00.157 INFO:teuthology.orchestra.run.smithi149.stdout:(25/51): dump-0.4-0.51.b47.el9.x86_64.rpm 173 kB/s | 88 kB 00:00 2023-08-25T09:43:00.349 INFO:teuthology.orchestra.run.smithi149.stdout:(26/51): indent-2.2.13-2.el9.x86_64.rpm 299 kB/s | 179 kB 00:00 2023-08-25T09:43:00.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:00.485 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:00.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:00.541 INFO:teuthology.orchestra.run.smithi149.stdout:(27/51): gcc-plugin-annobin-11.4.1-2.1.el9.x86_ 259 kB/s | 49 kB 00:00 2023-08-25T09:43:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:(28/51): gcc-11.4.1-2.1.el9.x86_64.rpm 34 MB/s | 32 MB 00:00 2023-08-25T09:43:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:(29/51): gcc-c++-11.4.1-2.1.el9.x86_64.rpm 11 MB/s | 13 MB 00:01 2023-08-25T09:43:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:(30/51): libstdc++-devel-11.4.1-2.1.el9.x86_64. 2.6 MB/s | 2.2 MB 00:00 2023-08-25T09:43:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:(31/51): python-unversioned-command-3.9.17-2.el 27 kB/s | 9.0 kB 00:00 2023-08-25T09:43:01.477 INFO:teuthology.orchestra.run.smithi149.stdout:(32/51): device-mapper-event-1.02.195-3.el9.x86 564 kB/s | 32 kB 00:00 2023-08-25T09:43:01.510 INFO:teuthology.orchestra.run.smithi149.stdout:(33/51): device-mapper-1.02.195-3.el9.x86_64.rp 1.5 MB/s | 138 kB 00:00 2023-08-25T09:43:01.579 INFO:teuthology.orchestra.run.smithi149.stdout:(34/51): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 205 kB 00:00 2023-08-25T09:43:01.619 INFO:teuthology.orchestra.run.smithi149.stdout:(35/51): device-mapper-event-libs-1.02.195-3.el 220 kB/s | 31 kB 00:00 2023-08-25T09:43:01.670 INFO:teuthology.orchestra.run.smithi149.stdout:(36/51): device-mapper-libs-1.02.195-3.el9.x86_ 1.1 MB/s | 177 kB 00:00 2023-08-25T09:43:01.719 INFO:teuthology.orchestra.run.smithi149.stdout:(37/51): gettext-libs-0.21-8.el9.x86_64.rpm 3.0 MB/s | 302 kB 00:00 2023-08-25T09:43:01.787 INFO:teuthology.orchestra.run.smithi149.stdout:(38/51): gettext-0.21-8.el9.x86_64.rpm 6.6 MB/s | 1.1 MB 00:00 2023-08-25T09:43:01.828 INFO:teuthology.orchestra.run.smithi149.stdout:(39/51): libedit-3.1-38.20210216cvs.el9.x86_64. 655 kB/s | 103 kB 00:00 2023-08-25T09:43:01.862 INFO:teuthology.orchestra.run.smithi149.stdout:(40/51): libgcc-11.4.1-2.1.el9.x86_64.rpm 725 kB/s | 94 kB 00:00 2023-08-25T09:43:01.921 INFO:teuthology.orchestra.run.smithi149.stdout:(41/51): libgomp-11.4.1-2.1.el9.x86_64.rpm 2.9 MB/s | 270 kB 00:00 2023-08-25T09:43:01.974 INFO:teuthology.orchestra.run.smithi149.stdout:(42/51): libstdc++-11.4.1-2.1.el9.x86_64.rpm 5.0 MB/s | 736 kB 00:00 2023-08-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi149.stdout:(43/51): lvm2-2.03.21-3.el9.x86_64.rpm 7.1 MB/s | 1.5 MB 00:00 2023-08-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi149.stdout:(44/51): python3-3.9.17-2.el9.x86_64.rpm 220 kB/s | 26 kB 00:00 2023-08-25T09:43:02.181 INFO:teuthology.orchestra.run.smithi149.stdout:(45/51): lvm2-libs-2.03.21-3.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2023-08-25T09:43:02.355 INFO:teuthology.orchestra.run.smithi149.stdout:(46/51): python3-libs-3.9.17-2.el9.x86_64.rpm 27 MB/s | 7.3 MB 00:00 2023-08-25T09:43:02.472 INFO:teuthology.orchestra.run.smithi149.stdout:(47/51): systemd-252-18.el9.x86_64.rpm 12 MB/s | 3.9 MB 00:00 2023-08-25T09:43:02.507 INFO:teuthology.orchestra.run.smithi149.stdout:(48/51): systemd-libs-252-18.el9.x86_64.rpm 2.1 MB/s | 653 kB 00:00 2023-08-25T09:43:02.531 INFO:teuthology.orchestra.run.smithi149.stdout:(49/51): systemd-pam-252-18.el9.x86_64.rpm 1.6 MB/s | 261 kB 00:00 2023-08-25T09:43:02.573 INFO:teuthology.orchestra.run.smithi149.stdout:(50/51): systemd-rpm-macros-252-18.el9.noarch.r 1.2 MB/s | 49 kB 00:00 2023-08-25T09:43:02.674 INFO:teuthology.orchestra.run.smithi149.stdout:(51/51): systemd-udev-252-18.el9.x86_64.rpm 13 MB/s | 1.8 MB 00:00 2023-08-25T09:43:02.680 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-08-25T09:43:02.681 INFO:teuthology.orchestra.run.smithi149.stdout:Total 18 MB/s | 88 MB 00:04 2023-08-25T09:43:02.911 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-08-25T09:43:03.283 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-08-25T09:43:03.283 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-08-25T09:43:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-08-25T09:43:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-08-25T09:43:07.343 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-08-25T09:43:07.415 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libgcc-11.4.1-2.1.el9.x86_64 1/77 2023-08-25T09:43:07.532 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 1/77 2023-08-25T09:43:07.608 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : systemd-libs-252-18.el9.x86_64 2/77 2023-08-25T09:43:07.820 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-libs-252-18.el9.x86_64 2/77 2023-08-25T09:43:07.917 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libstdc++-11.4.1-2.1.el9.x86_64 3/77 2023-08-25T09:43:07.988 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libgomp-11.4.1-2.1.el9.x86_64 4/77 2023-08-25T09:43:08.753 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libedit-3.1-38.20210216cvs.el9.x86_64 5/77 2023-08-25T09:43:08.864 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libstdc++-devel-11.4.1-2.1.el9.x86_64 6/77 2023-08-25T09:43:10.453 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : gettext-libs-0.21-8.el9.x86_64 7/77 2023-08-25T09:43:10.624 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : python3-libs-3.9.17-2.el9.x86_64 8/77 2023-08-25T09:43:10.676 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : python3-3.9.17-2.el9.x86_64 9/77 2023-08-25T09:43:10.709 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : python-unversioned-command-3.9.17-2.el9.noarch 10/77 2023-08-25T09:43:10.763 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : systemd-rpm-macros-252-18.el9.noarch 11/77 2023-08-25T09:43:11.524 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-252-18.el9.x86_64 12/77 2023-08-25T09:43:11.602 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : systemd-252-18.el9.x86_64 12/77 2023-08-25T09:43:12.112 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-252-18.el9.x86_64 12/77 2023-08-25T09:43:12.187 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : systemd-pam-252-18.el9.x86_64 13/77 2023-08-25T09:43:12.273 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : device-mapper-libs-9:1.02.195-3.el9.x86_64 14/77 2023-08-25T09:43:12.361 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : device-mapper-9:1.02.195-3.el9.x86_64 15/77 2023-08-25T09:43:12.413 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 16/77 2023-08-25T09:43:12.454 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : device-mapper-event-9:1.02.195-3.el9.x86_64 17/77 2023-08-25T09:43:12.826 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 17/77 2023-08-25T09:43:13.339 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : lvm2-libs-9:2.03.21-3.el9.x86_64 18/77 2023-08-25T09:43:13.802 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : systemd-devel-252-18.el9.x86_64 19/77 2023-08-25T09:43:14.981 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : cpp-11.4.1-2.1.el9.x86_64 20/77 2023-08-25T09:43:15.121 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : gcc-11.4.1-2.1.el9.x86_64 21/77 2023-08-25T09:43:15.154 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsepol-devel-3.5-0.rc1.2.el9.x86_64 22/77 2023-08-25T09:43:15.188 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rmt-2:1.6-6.el9.x86_64 23/77 2023-08-25T09:43:15.224 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf32-10.40-2.el9.x86_64 24/77 2023-08-25T09:43:15.398 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf16-10.40-2.el9.x86_64 25/77 2023-08-25T09:43:15.532 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-devel-10.40-2.el9.x86_64 26/77 2023-08-25T09:43:15.606 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libselinux-devel-3.5-0.rc1.1.el9.x86_64 27/77 2023-08-25T09:43:15.633 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libnbd-1.16.0-1.el9.x86_64 28/77 2023-08-25T09:43:15.658 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 29/77 2023-08-25T09:43:15.684 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 30/77 2023-08-25T09:43:15.710 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 31/77 2023-08-25T09:43:15.744 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 32/77 2023-08-25T09:43:15.778 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 33/77 2023-08-25T09:43:16.004 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 34/77 2023-08-25T09:43:16.045 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-3.35-1.el9.x86_64 35/77 2023-08-25T09:43:16.078 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : device-mapper-devel-9:1.02.195-3.el9.x86_64 36/77 2023-08-25T09:43:16.558 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 37/77 2023-08-25T09:43:16.624 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : gcc-c++-11.4.1-2.1.el9.x86_64 38/77 2023-08-25T09:43:16.663 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/77 2023-08-25T09:43:16.866 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/77 2023-08-25T09:43:16.867 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : lvm2-9:2.03.21-3.el9.x86_64 40/77 2023-08-25T09:43:16.867 INFO:teuthology.orchestra.run.smithi149.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2023-08-25T09:43:16.867 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:43:17.571 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 40/77 2023-08-25T09:43:17.694 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : systemd-udev-252-18.el9.x86_64 41/77 2023-08-25T09:43:18.428 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-udev-252-18.el9.x86_64 41/77 2023-08-25T09:43:18.637 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : python3-devel-3.9.17-2.el9.x86_64 42/77 2023-08-25T09:43:18.739 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : gettext-0.21-8.el9.x86_64 43/77 2023-08-25T09:43:18.829 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libedit-devel-3.1-38.20210216cvs.el9.x86_64 44/77 2023-08-25T09:43:18.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : indent-2.2.13-2.el9.x86_64 45/77 2023-08-25T09:43:19.012 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : userspace-rcu-devel-0.12.1-6.el9.x86_64 46/77 2023-08-25T09:43:19.065 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : systemd-boot-unsigned-252-17.el9.x86_64 47/77 2023-08-25T09:43:19.110 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : inih-devel-49-6.el9.x86_64 48/77 2023-08-25T09:43:19.469 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 49/77 2023-08-25T09:43:19.520 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libicu-devel-67.1-9.el9.x86_64 50/77 2023-08-25T09:43:19.551 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libblkid-devel-2.37.4-14.el9.x86_64 51/77 2023-08-25T09:43:19.574 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lvm2-9:2.03.17-4.el9.x86_64 52/77 2023-08-25T09:43:19.574 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : lvm2-9:2.03.17-4.el9.x86_64 52/77 2023-08-25T09:43:19.654 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lvm2-9:2.03.17-4.el9.x86_64 52/77 2023-08-25T09:43:19.685 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : lvm2-libs-9:2.03.17-4.el9.x86_64 53/77 2023-08-25T09:43:19.711 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: device-mapper-event-9:1.02.187-4.el9.x86_64 54/77 2023-08-25T09:43:19.756 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : device-mapper-event-9:1.02.187-4.el9.x86_64 54/77 2023-08-25T09:43:19.811 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-udev-252-3.el9.x86_64 55/77 2023-08-25T09:43:19.811 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : systemd-udev-252-3.el9.x86_64 55/77 2023-08-25T09:43:19.963 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-udev-252-3.el9.x86_64 55/77 2023-08-25T09:43:20.018 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : gettext-0.21-7.el9.x86_64 56/77 2023-08-25T09:43:20.082 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : gcc-c++-11.3.1-4.3.el9.x86_64 57/77 2023-08-25T09:43:20.125 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : python3-devel-3.9.16-1.el9.x86_64 58/77 2023-08-25T09:43:20.157 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : python3-3.9.16-1.el9.x86_64 59/77 2023-08-25T09:43:20.191 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : python-unversioned-command-3.9.16-1.el9.noarch 60/77 2023-08-25T09:43:20.224 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : device-mapper-event-libs-9:1.02.187-4.el9.x86_64 61/77 2023-08-25T09:43:20.259 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : device-mapper-libs-9:1.02.187-4.el9.x86_64 62/77 2023-08-25T09:43:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : device-mapper-9:1.02.187-4.el9.x86_64 63/77 2023-08-25T09:43:20.355 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : systemd-252-3.el9.x86_64 64/77 2023-08-25T09:43:20.800 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: systemd-252-3.el9.x86_64 64/77 2023-08-25T09:43:20.837 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : systemd-libs-252-3.el9.x86_64 65/77 2023-08-25T09:43:20.873 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : systemd-pam-252-3.el9.x86_64 66/77 2023-08-25T09:43:20.920 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : gcc-plugin-annobin-11.3.1-4.3.el9.x86_64 67/77 2023-08-25T09:43:20.982 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : gcc-11.3.1-4.3.el9.x86_64 68/77 2023-08-25T09:43:21.053 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : gettext-libs-0.21-7.el9.x86_64 69/77 2023-08-25T09:43:21.106 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libstdc++-devel-11.3.1-4.3.el9.x86_64 70/77 2023-08-25T09:43:21.131 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : systemd-rpm-macros-252-3.el9.noarch 71/77 2023-08-25T09:43:21.166 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libstdc++-11.3.1-4.3.el9.x86_64 72/77 2023-08-25T09:43:21.166 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libgcc-11.3.1-4.3.el9.x86_64 73/77 2023-08-25T09:43:21.295 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgcc-11.3.1-4.3.el9.x86_64 73/77 2023-08-25T09:43:21.359 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : cpp-11.3.1-4.3.el9.x86_64 74/77 2023-08-25T09:43:21.485 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libgomp-11.3.1-4.3.el9.x86_64 75/77 2023-08-25T09:43:21.562 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : python3-libs-3.9.16-1.el9.x86_64 76/77 2023-08-25T09:43:21.666 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libedit-3.1-37.20210216cvs.el9.x86_64 77/77 2023-08-25T09:43:22.990 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libedit-3.1-37.20210216cvs.el9.x86_64 77/77 2023-08-25T09:43:22.990 INFO:teuthology.orchestra.run.smithi149.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-25T09:43:22.990 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:43:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-3.35-1.el9.x86_64 1/77 2023-08-25T09:43:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/77 2023-08-25T09:43:25.338 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libblkid-devel-2.37.4-14.el9.x86_64 8/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libedit-devel-3.1-38.20210216cvs.el9.x86_64 9/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libicu-devel-67.1-9.el9.x86_64 10/77 2023-08-25T09:43:25.339 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnbd-1.16.0-1.el9.x86_64 11/77 2023-08-25T09:43:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-devel-10.40-2.el9.x86_64 12/77 2023-08-25T09:43:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf16-10.40-2.el9.x86_64 13/77 2023-08-25T09:43:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf32-10.40-2.el9.x86_64 14/77 2023-08-25T09:43:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 15/77 2023-08-25T09:43:25.340 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-devel-252-18.el9.x86_64 16/77 2023-08-25T09:43:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 17/77 2023-08-25T09:43:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libselinux-devel-3.5-0.rc1.1.el9.x86_64 18/77 2023-08-25T09:43:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsepol-devel-3.5-0.rc1.2.el9.x86_64 19/77 2023-08-25T09:43:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-devel-9:1.02.195-3.el9.x86_64 20/77 2023-08-25T09:43:25.341 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : inih-devel-49-6.el9.x86_64 21/77 2023-08-25T09:43:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-boot-unsigned-252-17.el9.x86_64 22/77 2023-08-25T09:43:25.342 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : userspace-rcu-devel-0.12.1-6.el9.x86_64 23/77 2023-08-25T09:43:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 24/77 2023-08-25T09:43:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : indent-2.2.13-2.el9.x86_64 25/77 2023-08-25T09:43:25.343 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 26/77 2023-08-25T09:43:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cpp-11.3.1-4.3.el9.x86_64 27/77 2023-08-25T09:43:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 28/77 2023-08-25T09:43:25.345 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gcc-11.3.1-4.3.el9.x86_64 29/77 2023-08-25T09:43:25.350 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 30/77 2023-08-25T09:43:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gcc-c++-11.3.1-4.3.el9.x86_64 31/77 2023-08-25T09:43:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 32/77 2023-08-25T09:43:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gcc-plugin-annobin-11.3.1-4.3.el9.x86_64 33/77 2023-08-25T09:43:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 34/77 2023-08-25T09:43:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libstdc++-devel-11.3.1-4.3.el9.x86_64 35/77 2023-08-25T09:43:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 36/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python-unversioned-command-3.9.16-1.el9.noarch 37/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 38/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.16-1.el9.x86_64 39/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 40/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-9:1.02.187-4.el9.x86_64 41/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 42/77 2023-08-25T09:43:25.352 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-event-9:1.02.187-4.el9.x86_64 43/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 44/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-event-libs-9:1.02.187-4.el9.x86_64 45/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 46/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : device-mapper-libs-9:1.02.187-4.el9.x86_64 47/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gettext-0.21-8.el9.x86_64 48/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gettext-0.21-7.el9.x86_64 49/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gettext-libs-0.21-8.el9.x86_64 50/77 2023-08-25T09:43:25.353 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gettext-libs-0.21-7.el9.x86_64 51/77 2023-08-25T09:43:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libedit-3.1-38.20210216cvs.el9.x86_64 52/77 2023-08-25T09:43:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libedit-3.1-37.20210216cvs.el9.x86_64 53/77 2023-08-25T09:43:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 54/77 2023-08-25T09:43:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgcc-11.3.1-4.3.el9.x86_64 55/77 2023-08-25T09:43:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 56/77 2023-08-25T09:43:25.354 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgomp-11.3.1-4.3.el9.x86_64 57/77 2023-08-25T09:43:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 58/77 2023-08-25T09:43:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libstdc++-11.3.1-4.3.el9.x86_64 59/77 2023-08-25T09:43:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 60/77 2023-08-25T09:43:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lvm2-9:2.03.17-4.el9.x86_64 61/77 2023-08-25T09:43:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 62/77 2023-08-25T09:43:25.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lvm2-libs-9:2.03.17-4.el9.x86_64 63/77 2023-08-25T09:43:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-3.9.17-2.el9.x86_64 64/77 2023-08-25T09:43:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-3.9.16-1.el9.x86_64 65/77 2023-08-25T09:43:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 66/77 2023-08-25T09:43:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-libs-3.9.16-1.el9.x86_64 67/77 2023-08-25T09:43:25.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-252-18.el9.x86_64 68/77 2023-08-25T09:43:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-252-3.el9.x86_64 69/77 2023-08-25T09:43:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-libs-252-18.el9.x86_64 70/77 2023-08-25T09:43:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-libs-252-3.el9.x86_64 71/77 2023-08-25T09:43:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-pam-252-18.el9.x86_64 72/77 2023-08-25T09:43:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-pam-252-3.el9.x86_64 73/77 2023-08-25T09:43:25.357 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-rpm-macros-252-18.el9.noarch 74/77 2023-08-25T09:43:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-rpm-macros-252-3.el9.noarch 75/77 2023-08-25T09:43:25.358 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-udev-252-18.el9.x86_64 76/77 2023-08-25T09:43:26.363 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : systemd-udev-252-3.el9.x86_64 77/77 2023-08-25T09:43:26.363 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:43:26.363 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-08-25T09:43:26.363 INFO:teuthology.orchestra.run.smithi149.stdout: cpp-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.363 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-9:1.02.195-3.el9.x86_64 2023-08-25T09:43:26.364 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-event-9:1.02.195-3.el9.x86_64 2023-08-25T09:43:26.364 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-event-libs-9:1.02.195-3.el9.x86_64 2023-08-25T09:43:26.364 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-libs-9:1.02.195-3.el9.x86_64 2023-08-25T09:43:26.364 INFO:teuthology.orchestra.run.smithi149.stdout: gcc-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.364 INFO:teuthology.orchestra.run.smithi149.stdout: gcc-c++-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.364 INFO:teuthology.orchestra.run.smithi149.stdout: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.365 INFO:teuthology.orchestra.run.smithi149.stdout: gettext-0.21-8.el9.x86_64 2023-08-25T09:43:26.365 INFO:teuthology.orchestra.run.smithi149.stdout: gettext-libs-0.21-8.el9.x86_64 2023-08-25T09:43:26.365 INFO:teuthology.orchestra.run.smithi149.stdout: libedit-3.1-38.20210216cvs.el9.x86_64 2023-08-25T09:43:26.365 INFO:teuthology.orchestra.run.smithi149.stdout: libgcc-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.365 INFO:teuthology.orchestra.run.smithi149.stdout: libgomp-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.365 INFO:teuthology.orchestra.run.smithi149.stdout: libstdc++-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.366 INFO:teuthology.orchestra.run.smithi149.stdout: libstdc++-devel-11.4.1-2.1.el9.x86_64 2023-08-25T09:43:26.366 INFO:teuthology.orchestra.run.smithi149.stdout: lvm2-9:2.03.21-3.el9.x86_64 2023-08-25T09:43:26.366 INFO:teuthology.orchestra.run.smithi149.stdout: lvm2-libs-9:2.03.21-3.el9.x86_64 2023-08-25T09:43:26.366 INFO:teuthology.orchestra.run.smithi149.stdout: python-unversioned-command-3.9.17-2.el9.noarch 2023-08-25T09:43:26.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-3.9.17-2.el9.x86_64 2023-08-25T09:43:26.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-08-25T09:43:26.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-libs-3.9.17-2.el9.x86_64 2023-08-25T09:43:26.368 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-252-18.el9.x86_64 2023-08-25T09:43:26.368 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-libs-252-18.el9.x86_64 2023-08-25T09:43:26.368 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-pam-252-18.el9.x86_64 2023-08-25T09:43:26.368 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-rpm-macros-252-18.el9.noarch 2023-08-25T09:43:26.369 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-udev-252-18.el9.x86_64 2023-08-25T09:43:26.369 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-08-25T09:43:26.369 INFO:teuthology.orchestra.run.smithi149.stdout: device-mapper-devel-9:1.02.195-3.el9.x86_64 2023-08-25T09:43:26.369 INFO:teuthology.orchestra.run.smithi149.stdout: dump-1:0.4-0.51.b47.el9.x86_64 2023-08-25T09:43:26.370 INFO:teuthology.orchestra.run.smithi149.stdout: fio-3.35-1.el9.x86_64 2023-08-25T09:43:26.370 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-http-3.35-1.el9.x86_64 2023-08-25T09:43:26.370 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-libaio-3.35-1.el9.x86_64 2023-08-25T09:43:26.371 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-nbd-3.35-1.el9.x86_64 2023-08-25T09:43:26.371 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-rados-3.35-1.el9.x86_64 2023-08-25T09:43:26.371 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-rbd-3.35-1.el9.x86_64 2023-08-25T09:43:26.372 INFO:teuthology.orchestra.run.smithi149.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2023-08-25T09:43:26.372 INFO:teuthology.orchestra.run.smithi149.stdout: indent-2.2.13-2.el9.x86_64 2023-08-25T09:43:26.372 INFO:teuthology.orchestra.run.smithi149.stdout: inih-devel-49-6.el9.x86_64 2023-08-25T09:43:26.373 INFO:teuthology.orchestra.run.smithi149.stdout: libblkid-devel-2.37.4-14.el9.x86_64 2023-08-25T09:43:26.373 INFO:teuthology.orchestra.run.smithi149.stdout: libedit-devel-3.1-38.20210216cvs.el9.x86_64 2023-08-25T09:43:26.373 INFO:teuthology.orchestra.run.smithi149.stdout: libicu-devel-67.1-9.el9.x86_64 2023-08-25T09:43:26.373 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd-1.16.0-1.el9.x86_64 2023-08-25T09:43:26.374 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel-3.5-0.rc1.1.el9.x86_64 2023-08-25T09:43:26.374 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel-3.5-0.rc1.2.el9.x86_64 2023-08-25T09:43:26.374 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel-10.40-2.el9.x86_64 2023-08-25T09:43:26.374 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16-10.40-2.el9.x86_64 2023-08-25T09:43:26.375 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32-10.40-2.el9.x86_64 2023-08-25T09:43:26.375 INFO:teuthology.orchestra.run.smithi149.stdout: rmt-2:1.6-6.el9.x86_64 2023-08-25T09:43:26.375 INFO:teuthology.orchestra.run.smithi149.stdout: sqlite-3.34.1-6.el9.x86_64 2023-08-25T09:43:26.376 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-boot-unsigned-252-17.el9.x86_64 2023-08-25T09:43:26.376 INFO:teuthology.orchestra.run.smithi149.stdout: systemd-devel-252-18.el9.x86_64 2023-08-25T09:43:26.376 INFO:teuthology.orchestra.run.smithi149.stdout: userspace-rcu-devel-0.12.1-6.el9.x86_64 2023-08-25T09:43:26.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:43:26.377 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-08-25T09:43:26.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo useradd -m fsgqa 2023-08-25T09:43:27.006 INFO:teuthology.orchestra.run.smithi149.stderr:useradd: user 'fsgqa' already exists 2023-08-25T09:43:27.009 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-25T09:43:27.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo groupadd fsgqa 2023-08-25T09:43:27.082 INFO:teuthology.orchestra.run.smithi149.stderr:groupadd: group 'fsgqa' already exists 2023-08-25T09:43:27.086 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-25T09:43:27.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo useradd fsgqa2 2023-08-25T09:43:27.753 DEBUG:teuthology.orchestra.run.smithi149:> sudo useradd 123456-fsgqa 2023-08-25T09:43:28.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-25T09:43:28.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 Processor -- start 2023-08-25T09:43:28.445 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 -- start start 2023-08-25T09:43:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bae60 0x7ff1d00be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1d00b3990 0x7ff1d00a5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d00be5b0 con 0x7ff1d00bfcf0 2023-08-25T09:43:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d006a390 con 0x7ff1d00b3990 2023-08-25T09:43:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1d5270640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00bf5c0 con 0x7ff1d00bae60 2023-08-25T09:43:28.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.443+0000 7ff1ce7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1d00b3990 0x7ff1d00a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ce7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1d00b3990 0x7ff1d00a5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38368/0 (socket says 172.21.15.89:38368) 2023-08-25T09:43:28.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ce7fc640 1 -- 172.21.15.89:0/2822522652 learned_addr learned my addr 172.21.15.89:0/2822522652 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:43:28.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1cf7fe640 1 --1- 172.21.15.89:0/2822522652 >> v1:172.21.15.89:6789/0 conn(0x7ff1d00bfcf0 0x7ff1d00a5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:44752/0 (socket says 172.21.15.89:44752) 2023-08-25T09:43:28.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ceffd640 1 --2- 172.21.15.89:0/2822522652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bae60 0x7ff1d00be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ce7fc640 1 -- 172.21.15.89:0/2822522652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bae60 msgr2=0x7ff1d00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:43:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ce7fc640 1 --2- 172.21.15.89:0/2822522652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bae60 0x7ff1d00be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ce7fc640 1 -- 172.21.15.89:0/2822522652 >> v1:172.21.15.89:6789/0 conn(0x7ff1d00bfcf0 legacy=0x7ff1d00a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1ce7fc640 1 -- 172.21.15.89:0/2822522652 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d006a580 con 0x7ff1d00b3990 2023-08-25T09:43:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.444+0000 7ff1cdffb640 1 -- 172.21.15.89:0/2822522652 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170927074 0 0) 0x7ff1d00be5b0 con 0x7ff1d00bfcf0 2023-08-25T09:43:28.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1ce7fc640 1 --2- 172.21.15.89:0/2822522652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d00a5500 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009870 tx=0x7ff1c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484fbb1c33ccbadd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:43:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1cdffb640 1 -- 172.21.15.89:0/2822522652 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4031640 con 0x7ff1d00b3990 2023-08-25T09:43:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1cdffb640 1 -- 172.21.15.89:0/2822522652 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c40317a0 con 0x7ff1d00b3990 2023-08-25T09:43:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1cdffb640 1 -- 172.21.15.89:0/2822522652 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4031b30 con 0x7ff1d00b3990 2023-08-25T09:43:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 -- 172.21.15.89:0/2822522652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 msgr2=0x7ff1d00a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 --2- 172.21.15.89:0/2822522652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d00a5500 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009870 tx=0x7ff1c402b8f0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 -- 172.21.15.89:0/2822522652 shutdown_connections 2023-08-25T09:43:28.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 --2- 172.21.15.89:0/2822522652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d00a5500 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 --2- 172.21.15.89:0/2822522652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bae60 0x7ff1d00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 -- 172.21.15.89:0/2822522652 >> 172.21.15.89:0/2822522652 conn(0x7ff1d00c0270 msgr2=0x7ff1d00c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:43:28.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 -- 172.21.15.89:0/2822522652 shutdown_connections 2023-08-25T09:43:28.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.445+0000 7ff1d5270640 1 -- 172.21.15.89:0/2822522652 wait complete. 2023-08-25T09:43:28.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.446+0000 7ff1d5270640 1 Processor -- start 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 -- start start 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d0146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1d00bae60 0x7ff1d01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bfcf0 0x7ff1d01e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d014e810 con 0x7ff1d00b3990 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d01470c0 con 0x7ff1d00bae60 2023-08-25T09:43:28.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1d5270640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d009f6f0 con 0x7ff1d00bfcf0 2023-08-25T09:43:28.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d0146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d0146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38384/0 (socket says 172.21.15.89:38384) 2023-08-25T09:43:28.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 -- 172.21.15.89:0/1193101339 learned_addr learned my addr 172.21.15.89:0/1193101339 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:43:28.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 -- 172.21.15.89:0/1193101339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bfcf0 msgr2=0x7ff1d01e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bfcf0 0x7ff1d01e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 -- 172.21.15.89:0/1193101339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1d00bae60 msgr2=0x7ff1d01438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1d00bae60 0x7ff1d01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.447+0000 7ff1ceffd640 1 -- 172.21.15.89:0/1193101339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c40094d0 con 0x7ff1d00b3990 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.448+0000 7ff1ceffd640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d0146b80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000d800 tx=0x7ff1c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.448+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000b660 con 0x7ff1d00b3990 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.448+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000b7c0 con 0x7ff1d00b3990 2023-08-25T09:43:28.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.448+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d014de70 con 0x7ff1d00b3990 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.448+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000bb50 con 0x7ff1d00b3990 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.448+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d014e430 con 0x7ff1d00b3990 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.449+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d014ea80 con 0x7ff1d00b3990 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.449+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff1c000bcb0 con 0x7ff1d00b3990 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.450+0000 7ff1b77fe640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff1bc06a050 0x7ff1bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.450+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1c0088a50 con 0x7ff1d00b3990 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.450+0000 7ff1ce7fc640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff1bc06a050 0x7ff1bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.450+0000 7ff1ce7fc640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff1bc06a050 0x7ff1bc06c510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4036000 tx=0x7ff1c4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:43:28.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.454+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff1c0054140 con 0x7ff1d00b3990 2023-08-25T09:43:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.687+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff1d0073bf0 con 0x7ff1d00b3990 2023-08-25T09:43:28.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.687+0000 7ff1b77fe640 1 -- 172.21.15.89:0/1193101339 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7ff1c0057760 con 0x7ff1d00b3990 2023-08-25T09:43:28.690 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:43:28.690 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","modified":"2023-08-25T09:41:01.929999Z","created":"2023-08-25T09:41:01.929999Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3301","nonce":0},{"type":"v1","addr":"172.21.15.121:6790","nonce":0}]},"addr":"172.21.15.121:6790/0","public_addr":"172.21.15.121:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-25T09:43:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2023-08-25T09:43:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff1bc06a050 msgr2=0x7ff1bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff1bc06a050 0x7ff1bc06c510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4036000 tx=0x7ff1c4030000 comp rx=0 tx=0).stop 2023-08-25T09:43:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 msgr2=0x7ff1d0146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d0146b80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000d800 tx=0x7ff1c000dcc0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 shutdown_connections 2023-08-25T09:43:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7ff1bc06a050 0x7ff1bc06c510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1d00bfcf0 0x7ff1d01e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1d00bae60 0x7ff1d01438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 --2- 172.21.15.89:0/1193101339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1d00b3990 0x7ff1d0146b80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 >> 172.21.15.89:0/1193101339 conn(0x7ff1d00c0270 msgr2=0x7ff1d00a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:43:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 shutdown_connections 2023-08-25T09:43:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.689+0000 7ff1d5270640 1 -- 172.21.15.89:0/1193101339 wait complete. 2023-08-25T09:43:28.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-08-25T09:43:28.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.800+0000 7f0dce6fa640 1 Processor -- start 2023-08-25T09:43:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dce6fa640 1 -- start start 2023-08-25T09:43:28.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dce6fa640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0dc8144c40 0x7f0dc80bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dce6fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 0x7f0dc80b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.810 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dce6fa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc8145020 con 0x7f0dc814ddb0 2023-08-25T09:43:28.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dce6fa640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80b9330 con 0x7f0dc8144c40 2023-08-25T09:43:28.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dce6fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80bd290 con 0x7f0dc80b6ec0 2023-08-25T09:43:28.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dccc97640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0dc814ddb0 0x7f0dc80babe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:44758/0 (socket says 172.21.15.89:44758) 2023-08-25T09:43:28.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.801+0000 7f0dccc97640 1 -- 172.21.15.89:0/4128283876 learned_addr learned my addr 172.21.15.89:0/4128283876 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:43:28.811 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106299751 0 0) 0x7f0dc8145020 con 0x7f0dc814ddb0 2023-08-25T09:43:28.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc77fe640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 0x7f0dc80b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc7fff640 1 --2- 172.21.15.89:0/4128283876 >> v2:172.21.15.121:3300/0 conn(0x7f0dc8144c40 0x7f0dc80bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db0003520 con 0x7f0dc814ddb0 2023-08-25T09:43:28.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068893302 0 0) 0x7f0db0003520 con 0x7f0dc814ddb0 2023-08-25T09:43:28.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 msgr2=0x7f0dc80b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:43:28.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 0x7f0dc80b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 >> v2:172.21.15.121:3300/0 conn(0x7f0dc8144c40 msgr2=0x7f0dc80bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:43:28.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 --2- 172.21.15.89:0/4128283876 >> v2:172.21.15.121:3300/0 conn(0x7f0dc8144c40 0x7f0dc80bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80b8850 con 0x7f0dc814ddb0 2023-08-25T09:43:28.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f0dc00019f0 con 0x7f0dc814ddb0 2023-08-25T09:43:28.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 >> v1:172.21.15.89:6789/0 conn(0x7f0dc814ddb0 legacy=0x7f0dc80babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db00039e0 0x7f0db0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 0x7f0db00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db0004d00 0x7f0db0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80b9330 con 0x7f0db0004d00 2023-08-25T09:43:28.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80bd290 con 0x7f0db00039e0 2023-08-25T09:43:28.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db000bab0 con 0x7f0dc80b6ec0 2023-08-25T09:43:28.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dccc97640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db0004d00 0x7f0db0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc7fff640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db00039e0 0x7f0db0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dc77fe640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 0x7f0db00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dccc97640 1 -- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 msgr2=0x7f0db00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dccc97640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc80b6ec0 0x7f0db00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dccc97640 1 -- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db00039e0 msgr2=0x7f0db0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dccc97640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db00039e0 0x7f0db0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.802+0000 7f0dccc97640 1 -- 172.21.15.89:0/4128283876 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0003520 con 0x7f0db0004d00 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.803+0000 7f0dccc97640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db0004d00 0x7f0db0005180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00013d0 tx=0x7f0db00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dd3fb78791055a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:43:28.816 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.803+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0034630 con 0x7f0db0004d00 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.803+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc002f070 con 0x7f0db0004d00 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.803+0000 7f0dc6ffd640 1 -- 172.21.15.89:0/4128283876 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00349d0 con 0x7f0db0004d00 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.803+0000 7f0dce6fa640 1 -- 172.21.15.89:0/4128283876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db0004d00 msgr2=0x7f0db0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.804+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/4128283876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db0004d00 0x7f0db0005180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00013d0 tx=0x7f0db00057f0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.804+0000 7f0dccc97640 1 -- 172.21.15.89:0/4128283876 reap_dead start 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.804+0000 7f0dce6fa640 1 -- 172.21.15.89:0/4128283876 shutdown_connections 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.804+0000 7f0dce6fa640 1 -- 172.21.15.89:0/4128283876 >> 172.21.15.89:0/4128283876 conn(0x7f0dc80654f0 msgr2=0x7f0dc80658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:43:28.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.804+0000 7f0dce6fa640 1 -- 172.21.15.89:0/4128283876 shutdown_connections 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.804+0000 7f0dce6fa640 1 -- 172.21.15.89:0/4128283876 wait complete. 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 Processor -- start 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 -- start start 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db0004d00 0x7f0dc80ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 0x7f0dc81e0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc81e05d0 0x7f0dc80aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80ad890 con 0x7f0dc80aee40 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80af8a0 con 0x7f0db0004d00 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.805+0000 7f0dce6fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80af2e0 con 0x7f0dc81e05d0 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 0x7f0dc81e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 0x7f0dc81e0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38394/0 (socket says 172.21.15.89:38394) 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 -- 172.21.15.89:0/2167417770 learned_addr learned my addr 172.21.15.89:0/2167417770 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc7fff640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db0004d00 0x7f0dc80ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dccc97640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc81e05d0 0x7f0dc80aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 -- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc81e05d0 msgr2=0x7f0dc80aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc81e05d0 0x7f0dc80aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 -- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db0004d00 msgr2=0x7f0dc80ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:28.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db0004d00 0x7f0dc80ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:28.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 -- 172.21.15.89:0/2167417770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80af5c0 con 0x7f0dc80aee40 2023-08-25T09:43:28.820 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc77fe640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 0x7f0dc81e0090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b7a0 tx=0x7f0db800bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8010830 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8010990 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc81dfb70 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8010d40 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.806+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc8143f60 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.807+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc814e950 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.808+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0db8014430 con 0x7f0dc80aee40 2023-08-25T09:43:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.808+0000 7f0dc4ff9640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0db406a050 0x7f0db406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:43:28.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.808+0000 7f0dc7fff640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0db406a050 0x7f0db406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:43:28.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.808+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0db8088bb0 con 0x7f0dc80aee40 2023-08-25T09:43:28.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.808+0000 7f0dc7fff640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0db406a050 0x7f0db406c510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc006fd0 tx=0x7f0dbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:43:28.822 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:28.812+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0db8054210 con 0x7f0dc80aee40 2023-08-25T09:43:29.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.038+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f0dc8073bf0 con 0x7f0dc80aee40 2023-08-25T09:43:29.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.039+0000 7f0dc4ff9640 1 -- 172.21.15.89:0/2167417770 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f0db8022020 con 0x7f0dc80aee40 2023-08-25T09:43:29.041 INFO:teuthology.orchestra.run.smithi089.stdout:[client.admin] 2023-08-25T09:43:29.041 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAud+hkcLwgExAACDhMTse7FXgXw35v69zYKw== 2023-08-25T09:43:29.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0db406a050 msgr2=0x7f0db406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:29.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0db406a050 0x7f0db406c510 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc006fd0 tx=0x7f0dbc008040 comp rx=0 tx=0).stop 2023-08-25T09:43:29.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 msgr2=0x7f0dc81e0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:43:29.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 0x7f0dc81e0090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b7a0 tx=0x7f0db800bc60 comp rx=0 tx=0).stop 2023-08-25T09:43:29.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 shutdown_connections 2023-08-25T09:43:29.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f0db406a050 0x7f0db406c510 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:29.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc80aee40 0x7f0dc81e0090 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:29.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0dc81e05d0 0x7f0dc80aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:29.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 --2- 172.21.15.89:0/2167417770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db0004d00 0x7f0dc80ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:43:29.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 >> 172.21.15.89:0/2167417770 conn(0x7f0dc80654f0 msgr2=0x7f0dc814e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:43:29.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 shutdown_connections 2023-08-25T09:43:29.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:43:29.041+0000 7f0dce6fa640 1 -- 172.21.15.89:0/2167417770 wait complete. 2023-08-25T09:43:29.054 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:43:29.055 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/tmp/tmp.pUGqPxeVwnxfstests-dev/local.config 2023-08-25T09:43:29.130 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.89:6789:/test export TEST_DIR=/tmp/tmp.Wj7ZcASf2Mtest export SCRATCH_DEV=172.21.15.89:6789:/scratch export SCRATCH_MNT=/tmp/tmp.CbXXksMJn5scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAud+hkcLwgExAACDhMTse7FXgXw35v69zYKw==" 2023-08-25T09:43:29.131 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:43:29.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/tmp/tmp.pUGqPxeVwnxfstests-dev/ceph.exclude 2023-08-25T09:43:29.246 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.pUGqPxeVwnxfstests-dev && exec sudo make) 2023-08-25T09:43:29.378 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize -cfi 2023-08-25T09:43:29.990 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: putting auxiliary files in '.'. 2023-08-25T09:43:29.991 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './config.guess' 2023-08-25T09:43:30.001 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './config.sub' 2023-08-25T09:43:30.012 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './install-sh' 2023-08-25T09:43:30.023 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './ltmain.sh' 2023-08-25T09:43:30.091 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-25T09:43:30.091 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-25T09:43:30.103 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-25T09:43:30.117 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-25T09:43:30.131 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-25T09:43:30.145 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-25T09:43:30.164 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-25T09:43:30.168 INFO:teuthology.orchestra.run.smithi149.stdout:cp include/install-sh . 2023-08-25T09:43:30.170 INFO:teuthology.orchestra.run.smithi149.stdout:aclocal -I m4 2023-08-25T09:43:30.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:30.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:30.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:31.427 INFO:teuthology.orchestra.run.smithi149.stdout:autoheader 2023-08-25T09:43:31.812 INFO:teuthology.orchestra.run.smithi149.stdout:autoconf 2023-08-25T09:43:32.073 INFO:teuthology.orchestra.run.smithi149.stdout:./configure \ 2023-08-25T09:43:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: --libexecdir=/usr/lib \ 2023-08-25T09:43:32.074 INFO:teuthology.orchestra.run.smithi149.stdout: --exec_prefix=/var/lib 2023-08-25T09:43:32.465 INFO:teuthology.orchestra.run.smithi149.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-25T09:43:32.466 INFO:teuthology.orchestra.run.smithi149.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-25T09:43:32.468 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to print strings... printf 2023-08-25T09:43:32.469 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... gcc 2023-08-25T09:43:32.603 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether the C compiler works... yes 2023-08-25T09:43:32.603 INFO:teuthology.orchestra.run.smithi149.stdout:checking for C compiler default output file name... a.out 2023-08-25T09:43:32.659 INFO:teuthology.orchestra.run.smithi149.stdout:checking for suffix of executables... 2023-08-25T09:43:32.741 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are cross compiling... no 2023-08-25T09:43:32.779 INFO:teuthology.orchestra.run.smithi149.stdout:checking for suffix of object files... o 2023-08-25T09:43:32.813 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... yes 2023-08-25T09:43:32.847 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... yes 2023-08-25T09:43:32.897 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-25T09:43:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-25T09:43:32.909 INFO:teuthology.orchestra.run.smithi149.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-25T09:43:32.913 INFO:teuthology.orchestra.run.smithi149.stdout:checking for egrep... /bin/grep -E 2023-08-25T09:43:32.917 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fgrep... /bin/grep -F 2023-08-25T09:43:32.925 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ld used by gcc... /bin/ld 2023-08-25T09:43:32.929 INFO:teuthology.orchestra.run.smithi149.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-25T09:43:32.946 INFO:teuthology.orchestra.run.smithi149.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-25T09:43:35.019 INFO:teuthology.orchestra.run.smithi149.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-25T09:43:35.020 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether ln -s works... yes 2023-08-25T09:43:35.038 INFO:teuthology.orchestra.run.smithi149.stdout:checking the maximum length of command line arguments... 1572864 2023-08-25T09:43:35.049 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-25T09:43:35.049 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-25T09:43:35.050 INFO:teuthology.orchestra.run.smithi149.stdout:checking for /bin/ld option to reload object files... -r 2023-08-25T09:43:35.050 INFO:teuthology.orchestra.run.smithi149.stdout:checking for objdump... objdump 2023-08-25T09:43:35.051 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to recognize dependent libraries... pass_all 2023-08-25T09:43:35.052 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dlltool... no 2023-08-25T09:43:35.052 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-25T09:43:35.053 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ar... ar 2023-08-25T09:43:35.188 INFO:teuthology.orchestra.run.smithi149.stdout:checking for archiver @FILE support... @ 2023-08-25T09:43:35.189 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strip... strip 2023-08-25T09:43:35.189 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ranlib... ranlib 2023-08-25T09:43:35.190 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gawk... gawk 2023-08-25T09:43:35.369 INFO:teuthology.orchestra.run.smithi149.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-25T09:43:35.373 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sysroot... no 2023-08-25T09:43:35.384 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a working dd... /bin/dd 2023-08-25T09:43:35.395 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-25T09:43:35.436 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mt... no 2023-08-25T09:43:35.447 INFO:teuthology.orchestra.run.smithi149.stdout:checking if : is a manifest tool... no 2023-08-25T09:43:35.548 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to run the C preprocessor... gcc -E 2023-08-25T09:43:35.875 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ANSI C header files... yes 2023-08-25T09:43:35.935 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/types.h... yes 2023-08-25T09:43:36.003 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/stat.h... yes 2023-08-25T09:43:36.075 INFO:teuthology.orchestra.run.smithi149.stdout:checking for stdlib.h... yes 2023-08-25T09:43:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:checking for string.h... yes 2023-08-25T09:43:36.221 INFO:teuthology.orchestra.run.smithi149.stdout:checking for memory.h... yes 2023-08-25T09:43:36.284 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strings.h... yes 2023-08-25T09:43:36.350 INFO:teuthology.orchestra.run.smithi149.stdout:checking for inttypes.h... yes 2023-08-25T09:43:36.426 INFO:teuthology.orchestra.run.smithi149.stdout:checking for stdint.h... yes 2023-08-25T09:43:36.507 INFO:teuthology.orchestra.run.smithi149.stdout:checking for unistd.h... yes 2023-08-25T09:43:36.579 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dlfcn.h... yes 2023-08-25T09:43:36.591 INFO:teuthology.orchestra.run.smithi149.stdout:checking for objdir... .libs 2023-08-25T09:43:36.769 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-25T09:43:36.769 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-25T09:43:36.823 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-25T09:43:36.873 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc static flag -static works... no 2023-08-25T09:43:36.941 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -c -o file.o... yes 2023-08-25T09:43:36.942 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-25T09:43:36.967 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-25T09:43:37.028 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether -lc should be explicitly linked in... no 2023-08-25T09:43:37.170 INFO:teuthology.orchestra.run.smithi149.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-25T09:43:37.170 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to hardcode library paths into programs... immediate 2023-08-25T09:43:37.174 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether stripping libraries is possible... yes 2023-08-25T09:43:37.175 INFO:teuthology.orchestra.run.smithi149.stdout:checking if libtool supports shared libraries... yes 2023-08-25T09:43:37.175 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether to build shared libraries... yes 2023-08-25T09:43:37.175 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether to build static libraries... yes 2023-08-25T09:43:37.196 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... (cached) gcc 2023-08-25T09:43:37.249 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-25T09:43:37.249 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-25T09:43:37.250 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-25T09:43:37.250 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gmake... /usr/bin/gmake 2023-08-25T09:43:37.251 INFO:teuthology.orchestra.run.smithi149.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-08-25T09:43:37.251 INFO:teuthology.orchestra.run.smithi149.stdout:checking for tar... /bin/tar 2023-08-25T09:43:37.251 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gzip... /bin/gzip 2023-08-25T09:43:37.277 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc -MM is supported... yes 2023-08-25T09:43:37.277 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sort... /bin/sort 2023-08-25T09:43:37.277 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether ln -s works... yes 2023-08-25T09:43:37.278 INFO:teuthology.orchestra.run.smithi149.stdout:checking for rpm... /bin/rpm 2023-08-25T09:43:37.288 INFO:teuthology.orchestra.run.smithi149.stdout:checking for rpmbuild... no 2023-08-25T09:43:37.354 INFO:teuthology.orchestra.run.smithi149.stdout:checking assert.h usability... yes 2023-08-25T09:43:37.378 INFO:teuthology.orchestra.run.smithi149.stdout:checking assert.h presence... yes 2023-08-25T09:43:37.378 INFO:teuthology.orchestra.run.smithi149.stdout:checking for assert.h... yes 2023-08-25T09:43:37.456 INFO:teuthology.orchestra.run.smithi149.stdout:checking bstring.h usability... no 2023-08-25T09:43:37.493 INFO:teuthology.orchestra.run.smithi149.stdout:checking bstring.h presence... no 2023-08-25T09:43:37.493 INFO:teuthology.orchestra.run.smithi149.stdout:checking for bstring.h... no 2023-08-25T09:43:37.552 INFO:teuthology.orchestra.run.smithi149.stdout:checking libgen.h usability... yes 2023-08-25T09:43:37.573 INFO:teuthology.orchestra.run.smithi149.stdout:checking libgen.h presence... yes 2023-08-25T09:43:37.573 INFO:teuthology.orchestra.run.smithi149.stdout:checking for libgen.h... yes 2023-08-25T09:43:37.646 INFO:teuthology.orchestra.run.smithi149.stdout:checking dirent.h usability... yes 2023-08-25T09:43:37.673 INFO:teuthology.orchestra.run.smithi149.stdout:checking dirent.h presence... yes 2023-08-25T09:43:37.674 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dirent.h... yes 2023-08-25T09:43:37.764 INFO:teuthology.orchestra.run.smithi149.stdout:checking errno.h usability... yes 2023-08-25T09:43:37.792 INFO:teuthology.orchestra.run.smithi149.stdout:checking errno.h presence... yes 2023-08-25T09:43:37.792 INFO:teuthology.orchestra.run.smithi149.stdout:checking for errno.h... yes 2023-08-25T09:43:37.866 INFO:teuthology.orchestra.run.smithi149.stdout:checking malloc.h usability... yes 2023-08-25T09:43:37.895 INFO:teuthology.orchestra.run.smithi149.stdout:checking malloc.h presence... yes 2023-08-25T09:43:37.895 INFO:teuthology.orchestra.run.smithi149.stdout:checking for malloc.h... yes 2023-08-25T09:43:37.974 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid.h usability... no 2023-08-25T09:43:38.016 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid.h presence... no 2023-08-25T09:43:38.017 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid.h... no 2023-08-25T09:43:38.088 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid/uuid.h usability... yes 2023-08-25T09:43:38.118 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid/uuid.h presence... yes 2023-08-25T09:43:38.119 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid/uuid.h... yes 2023-08-25T09:43:38.195 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/uuid.h usability... no 2023-08-25T09:43:38.233 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/uuid.h presence... no 2023-08-25T09:43:38.234 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/uuid.h... no 2023-08-25T09:43:38.302 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/file.h usability... yes 2023-08-25T09:43:38.329 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/file.h presence... yes 2023-08-25T09:43:38.330 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/file.h... yes 2023-08-25T09:43:38.408 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fcntl.h usability... yes 2023-08-25T09:43:38.435 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fcntl.h presence... yes 2023-08-25T09:43:38.436 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/fcntl.h... yes 2023-08-25T09:43:38.517 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/syssgi.h usability... no 2023-08-25T09:43:38.555 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/syssgi.h presence... no 2023-08-25T09:43:38.556 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/syssgi.h... no 2023-08-25T09:43:38.658 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/param.h usability... yes 2023-08-25T09:43:38.692 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/param.h presence... yes 2023-08-25T09:43:38.692 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/param.h... yes 2023-08-25T09:43:38.710 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/stat.h... (cached) yes 2023-08-25T09:43:38.786 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/statvfs.h usability... yes 2023-08-25T09:43:38.811 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/statvfs.h presence... yes 2023-08-25T09:43:38.811 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/statvfs.h... yes 2023-08-25T09:43:38.884 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/time.h usability... yes 2023-08-25T09:43:38.913 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/time.h presence... yes 2023-08-25T09:43:38.914 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/time.h... yes 2023-08-25T09:43:38.999 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/ioctl.h usability... yes 2023-08-25T09:43:39.026 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/ioctl.h presence... yes 2023-08-25T09:43:39.026 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/ioctl.h... yes 2023-08-25T09:43:39.108 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/wait.h usability... yes 2023-08-25T09:43:39.139 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/wait.h presence... yes 2023-08-25T09:43:39.139 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/wait.h... yes 2023-08-25T09:43:39.158 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/types.h... (cached) yes 2023-08-25T09:43:39.175 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strings.h... (cached) yes 2023-08-25T09:43:39.274 INFO:teuthology.orchestra.run.smithi149.stdout:checking err.h usability... yes 2023-08-25T09:43:39.300 INFO:teuthology.orchestra.run.smithi149.stdout:checking err.h presence... yes 2023-08-25T09:43:39.301 INFO:teuthology.orchestra.run.smithi149.stdout:checking for err.h... yes 2023-08-25T09:43:39.372 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/falloc.h usability... yes 2023-08-25T09:43:39.397 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/falloc.h presence... yes 2023-08-25T09:43:39.398 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/falloc.h... yes 2023-08-25T09:43:39.473 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-08-25T09:43:39.510 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-08-25T09:43:39.511 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/fs/xfs_fsops.h... no 2023-08-25T09:43:39.580 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_itable.h usability... no 2023-08-25T09:43:39.621 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_itable.h presence... no 2023-08-25T09:43:39.621 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/fs/xfs_itable.h... no 2023-08-25T09:43:39.692 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/platform_defs.h usability... no 2023-08-25T09:43:39.735 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/platform_defs.h presence... no 2023-08-25T09:43:39.735 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/platform_defs.h... no 2023-08-25T09:43:39.806 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfs/ioctl.h usability... no 2023-08-25T09:43:39.845 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfs/ioctl.h presence... no 2023-08-25T09:43:39.845 INFO:teuthology.orchestra.run.smithi149.stdout:checking for btrfs/ioctl.h... no 2023-08-25T09:43:39.921 INFO:teuthology.orchestra.run.smithi149.stdout:checking cifs/ioctl.h usability... no 2023-08-25T09:43:39.969 INFO:teuthology.orchestra.run.smithi149.stdout:checking cifs/ioctl.h presence... no 2023-08-25T09:43:39.970 INFO:teuthology.orchestra.run.smithi149.stdout:checking for cifs/ioctl.h... no 2023-08-25T09:43:40.044 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/mman.h usability... yes 2023-08-25T09:43:40.072 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/mman.h presence... yes 2023-08-25T09:43:40.072 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/mman.h... yes 2023-08-25T09:43:40.126 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/xfs_log_format.h... no 2023-08-25T09:43:40.220 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid_compare... no 2023-08-25T09:43:40.295 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid_compare in -luuid... yes 2023-08-25T09:43:40.422 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/xfs.h... yes 2023-08-25T09:43:40.470 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/libxfs.h... no 2023-08-25T09:43:40.532 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether xlog_assign_lsn is declared... no 2023-08-25T09:43:40.607 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/xqm.h... yes 2023-08-25T09:43:40.716 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfsctl from xfs/xfs.h... ok 2023-08-25T09:43:40.781 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/handle.h usability... yes 2023-08-25T09:43:40.805 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/handle.h presence... yes 2023-08-25T09:43:40.805 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/handle.h... yes 2023-08-25T09:43:40.886 INFO:teuthology.orchestra.run.smithi149.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-08-25T09:43:40.960 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/acl.h usability... yes 2023-08-25T09:43:40.986 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/acl.h presence... yes 2023-08-25T09:43:40.987 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/acl.h... yes 2023-08-25T09:43:41.063 INFO:teuthology.orchestra.run.smithi149.stdout:checking acl/libacl.h usability... yes 2023-08-25T09:43:41.092 INFO:teuthology.orchestra.run.smithi149.stdout:checking acl/libacl.h presence... yes 2023-08-25T09:43:41.093 INFO:teuthology.orchestra.run.smithi149.stdout:checking for acl/libacl.h... yes 2023-08-25T09:43:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:checking for acl_init in -lacl... yes 2023-08-25T09:43:41.238 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm-ndbm.h usability... no 2023-08-25T09:43:41.278 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm-ndbm.h presence... no 2023-08-25T09:43:41.278 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gdbm-ndbm.h... no 2023-08-25T09:43:41.343 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm/ndbm.h usability... no 2023-08-25T09:43:41.383 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm/ndbm.h presence... no 2023-08-25T09:43:41.383 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gdbm/ndbm.h... no 2023-08-25T09:43:41.448 INFO:teuthology.orchestra.run.smithi149.stdout:checking ndbm.h usability... no 2023-08-25T09:43:41.488 INFO:teuthology.orchestra.run.smithi149.stdout:checking ndbm.h presence... no 2023-08-25T09:43:41.489 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ndbm.h... no 2023-08-25T09:43:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:checking libaio.h usability... yes 2023-08-25T09:43:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:checking libaio.h presence... yes 2023-08-25T09:43:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:checking for libaio.h... yes 2023-08-25T09:43:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:checking liburing.h usability... no 2023-08-25T09:43:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:checking liburing.h presence... no 2023-08-25T09:43:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:checking for liburing.h... no 2023-08-25T09:43:41.760 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/capability.h usability... no 2023-08-25T09:43:41.800 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/capability.h presence... no 2023-08-25T09:43:41.801 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/capability.h... no 2023-08-25T09:43:41.863 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fiemap.h usability... yes 2023-08-25T09:43:41.891 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fiemap.h presence... yes 2023-08-25T09:43:41.891 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/fiemap.h... yes 2023-08-25T09:43:41.975 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fallocate... yes 2023-08-25T09:43:42.058 INFO:teuthology.orchestra.run.smithi149.stdout:checking for open_by_handle_at... yes 2023-08-25T09:43:42.121 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/prctl.h usability... yes 2023-08-25T09:43:42.147 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/prctl.h presence... yes 2023-08-25T09:43:42.147 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/prctl.h... yes 2023-08-25T09:43:42.212 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fs.h usability... yes 2023-08-25T09:43:42.240 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fs.h presence... yes 2023-08-25T09:43:42.240 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/fs.h... yes 2023-08-25T09:43:42.304 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfsutil.h usability... no 2023-08-25T09:43:42.346 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfsutil.h presence... no 2023-08-25T09:43:42.346 INFO:teuthology.orchestra.run.smithi149.stdout:checking for btrfsutil.h... no 2023-08-25T09:43:42.434 INFO:teuthology.orchestra.run.smithi149.stdout:checking for copy_file_range... yes 2023-08-25T09:43:42.518 INFO:teuthology.orchestra.run.smithi149.stdout:checking for SEEK_DATA... yes 2023-08-25T09:43:42.630 INFO:teuthology.orchestra.run.smithi149.stdout:checking for BMV_OF_SHARED... yes 2023-08-25T09:43:42.720 INFO:teuthology.orchestra.run.smithi149.stdout:checking for nftw... yes 2023-08-25T09:43:42.806 INFO:teuthology.orchestra.run.smithi149.stdout:checking for RLIMIT_NOFILE... yes 2023-08-25T09:43:42.859 INFO:teuthology.orchestra.run.smithi149.stdout:checking for FIEXCHANGE_RANGE... no 2023-08-25T09:43:42.942 INFO:teuthology.orchestra.run.smithi149.stdout:checking for renameat2... yes 2023-08-25T09:43:43.027 INFO:teuthology.orchestra.run.smithi149.stdout:checking for reallocarray... yes 2023-08-25T09:43:43.114 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct mount_attr... yes 2023-08-25T09:43:43.213 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_qgroup_limit... yes 2023-08-25T09:43:43.307 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-08-25T09:43:43.409 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-08-25T09:43:43.515 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-08-25T09:43:43.616 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-08-25T09:43:43.725 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-08-25T09:43:43.831 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-08-25T09:43:43.905 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs.h usability... yes 2023-08-25T09:43:43.933 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs.h presence... yes 2023-08-25T09:43:43.933 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/btrfs.h... yes 2023-08-25T09:43:44.010 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs_tree.h usability... yes 2023-08-25T09:43:44.036 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs_tree.h presence... yes 2023-08-25T09:43:44.037 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/btrfs_tree.h... yes 2023-08-25T09:43:44.097 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-08-25T09:43:44.139 INFO:teuthology.orchestra.run.smithi149.stdout:configure: creating ./config.status 2023-08-25T09:43:45.444 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: creating include/builddefs 2023-08-25T09:43:45.482 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: creating include/config.h 2023-08-25T09:43:45.511 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: executing libtool commands 2023-08-25T09:43:45.608 INFO:teuthology.orchestra.run.smithi149.stdout:Building include 2023-08-25T09:43:45.617 INFO:teuthology.orchestra.run.smithi149.stdout:Building lib 2023-08-25T09:43:45.626 INFO:teuthology.orchestra.run.smithi149.stdout: [LTDEP] 2023-08-25T09:43:45.937 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dataascii.lo 2023-08-25T09:43:46.226 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] databin.lo 2023-08-25T09:43:46.534 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] datapid.lo 2023-08-25T09:43:46.770 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] file_lock.lo 2023-08-25T09:43:47.062 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] forker.lo 2023-08-25T09:43:47.341 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] pattern.lo 2023-08-25T09:43:47.601 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] open_flags.lo 2023-08-25T09:43:47.896 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] random_range.lo 2023-08-25T09:43:48.292 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] string_to_tokens.lo 2023-08-25T09:43:48.532 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] str_to_bytes.lo 2023-08-25T09:43:48.802 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] tlibio.lo 2023-08-25T09:43:49.209 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] write_log.lo 2023-08-25T09:43:49.598 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] random.lo 2023-08-25T09:43:49.853 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] 2023-08-25T09:43:50.090 INFO:teuthology.orchestra.run.smithi149.stdout:Building ltp 2023-08-25T09:43:50.100 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-08-25T09:43:50.366 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] doio 2023-08-25T09:43:51.270 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsstress 2023-08-25T09:43:52.941 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsx 2023-08-25T09:43:53.904 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] growfiles 2023-08-25T09:43:54.624 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] iogen 2023-08-25T09:43:55.211 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-stress 2023-08-25T09:43:55.859 INFO:teuthology.orchestra.run.smithi149.stdout:Building src 2023-08-25T09:43:55.875 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-08-25T09:43:59.588 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-08-25T09:43:59.667 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-08-25T09:43:59.688 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-08-25T09:44:00.172 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-08-25T09:44:00.230 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dirstress 2023-08-25T09:44:00.674 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fill 2023-08-25T09:44:00.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:00.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:00.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:00.975 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fill2 2023-08-25T09:44:01.393 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] getpagesize 2023-08-25T09:44:01.703 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] holes 2023-08-25T09:44:02.102 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] lstat64 2023-08-25T09:44:02.462 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] nametest 2023-08-25T09:44:02.907 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] permname 2023-08-25T09:44:03.272 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] randholes 2023-08-25T09:44:03.737 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] runas 2023-08-25T09:44:04.078 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] truncfile 2023-08-25T09:44:04.443 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] usemem 2023-08-25T09:44:04.772 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmapcat 2023-08-25T09:44:05.099 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] append_reader 2023-08-25T09:44:05.407 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] append_writer 2023-08-25T09:44:05.732 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dirperf 2023-08-25T09:44:06.173 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] metaperf 2023-08-25T09:44:06.670 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] devzero 2023-08-25T09:44:07.047 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] feature 2023-08-25T09:44:07.459 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] alloc 2023-08-25T09:44:07.889 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fault 2023-08-25T09:44:08.261 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fstest 2023-08-25T09:44:08.702 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_access_root 2023-08-25T09:44:09.033 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] godown 2023-08-25T09:44:09.378 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] resvtest 2023-08-25T09:44:09.783 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] writemod 2023-08-25T09:44:10.093 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] writev_on_pagefault 2023-08-25T09:44:10.429 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] makeextents 2023-08-25T09:44:10.815 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] itrash 2023-08-25T09:44:11.172 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] rename 2023-08-25T09:44:11.507 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] multi_open_unlink 2023-08-25T09:44:11.838 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] unwritten_sync 2023-08-25T09:44:12.207 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] genhashnames 2023-08-25T09:44:12.555 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_holes 2023-08-25T09:44:12.855 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_writev 2023-08-25T09:44:13.182 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_truncate_cmtime 2023-08-25T09:44:13.512 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dirhash_collide 2023-08-25T09:44:13.905 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_rename_overwrite 2023-08-25T09:44:14.229 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] holetest 2023-08-25T09:44:14.655 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_truncate_self 2023-08-25T09:44:14.999 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] af_unix 2023-08-25T09:44:15.319 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_stale_pmd 2023-08-25T09:44:15.651 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_cow_race 2023-08-25T09:44:15.981 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_fallocate 2023-08-25T09:44:16.370 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsync-err 2023-08-25T09:44:16.746 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_write_ro 2023-08-25T09:44:17.089 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_ext4_dax_journal_corruption 2023-08-25T09:44:17.435 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_ext4_dax_inline_corruption 2023-08-25T09:44:17.804 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_ofd_locks 2023-08-25T09:44:18.201 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_collision 2023-08-25T09:44:18.580 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmap-write-concurrent 2023-08-25T09:44:18.945 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_get_file_time 2023-08-25T09:44:19.266 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_create_short_dirs 2023-08-25T09:44:19.623 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_create_long_dirs 2023-08-25T09:44:19.968 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_enospc 2023-08-25T09:44:20.339 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_writev_overlap 2023-08-25T09:44:20.659 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] checkpoint_journal 2023-08-25T09:44:21.013 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmap-rw-fault 2023-08-25T09:44:21.377 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] allocstale 2023-08-25T09:44:21.704 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_cow_memory_failure 2023-08-25T09:44:22.059 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fake-dump-rootino 2023-08-25T09:44:22.416 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dio-buf-fault 2023-08-25T09:44:22.724 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfsctl 2023-08-25T09:44:23.072 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bstat 2023-08-25T09:44:23.453 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mtab 2023-08-25T09:44:23.827 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] getdevicesize 2023-08-25T09:44:24.174 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] preallo_rw_pattern_reader 2023-08-25T09:44:24.552 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] preallo_rw_pattern_writer 2023-08-25T09:44:24.916 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] ftrunc 2023-08-25T09:44:25.246 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] trunc 2023-08-25T09:44:25.611 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fs_perms 2023-08-25T09:44:25.969 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] testx 2023-08-25T09:44:26.286 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] looptest 2023-08-25T09:44:26.654 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] locktest 2023-08-25T09:44:27.183 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] unwritten_mmap 2023-08-25T09:44:27.528 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat_unlink_test 2023-08-25T09:44:27.923 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] deduperace 2023-08-25T09:44:28.301 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat_unlink_test_modified 2023-08-25T09:44:28.713 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_dir_offset 2023-08-25T09:44:29.057 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_futimens 2023-08-25T09:44:29.381 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_immutable 2023-08-25T09:44:30.201 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] stale_handle 2023-08-25T09:44:30.569 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] pwrite_mmap_blocked 2023-08-25T09:44:30.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:30.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:30.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:30.911 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_dir_offset2 2023-08-25T09:44:31.243 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] seek_sanity_test 2023-08-25T09:44:31.894 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] seek_copy_test 2023-08-25T09:44:32.259 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_readdir_1 2023-08-25T09:44:32.595 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_readdir_2 2023-08-25T09:44:32.926 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsync-tester 2023-08-25T09:44:33.370 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] nsexec 2023-08-25T09:44:33.770 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] cloner 2023-08-25T09:44:34.116 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] renameat2 2023-08-25T09:44:34.468 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_getcwd 2023-08-25T09:44:34.841 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] e4compact 2023-08-25T09:44:35.211 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] test-nextquota 2023-08-25T09:44:35.546 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] punch-alternating 2023-08-25T09:44:35.897 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr-list-by-handle-cursor-test 2023-08-25T09:44:36.241 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] listxattr 2023-08-25T09:44:36.550 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dio-interleaved 2023-08-25T09:44:36.912 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_dir_type 2023-08-25T09:44:37.237 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dio-invalidate-cache 2023-08-25T09:44:37.649 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] stat_test 2023-08-25T09:44:38.176 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_encrypted_d_revalidate 2023-08-25T09:44:38.552 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr_replace_test 2023-08-25T09:44:38.935 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] swapon 2023-08-25T09:44:39.280 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mkswap 2023-08-25T09:44:39.603 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_attr_corruption 2023-08-25T09:44:39.934 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_open_tmpfiles 2023-08-25T09:44:40.287 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fscrypt-crypt-util 2023-08-25T09:44:41.160 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat_null_ocount 2023-08-25T09:44:41.492 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] splice-test 2023-08-25T09:44:41.844 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] chprojid_fail 2023-08-25T09:44:42.199 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] detached_mounts_propagation 2023-08-25T09:44:42.577 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] ext4_resize 2023-08-25T09:44:42.898 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_readdir_3 2023-08-25T09:44:43.308 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] splice2pipe 2023-08-25T09:44:43.675 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] uuid_ioctl 2023-08-25T09:44:44.034 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fiemap-tester 2023-08-25T09:44:44.523 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_stripealign 2023-08-25T09:44:44.875 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] open_by_handle 2023-08-25T09:44:45.339 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_dio 2023-08-25T09:44:45.679 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfsfind 2023-08-25T09:44:46.065 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fssum 2023-08-25T09:44:46.731 INFO:teuthology.orchestra.run.smithi149.stdout:Building log-writes 2023-08-25T09:44:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] replay-log 2023-08-25T09:44:47.242 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-08-25T09:44:47.252 INFO:teuthology.orchestra.run.smithi149.stdout:Building aio-dio-regress 2023-08-25T09:44:47.269 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aiocp 2023-08-25T09:44:47.714 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-append-write-fallocate-race 2023-08-25T09:44:48.075 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-append-write-read-race 2023-08-25T09:44:48.440 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-cow-race 2023-08-25T09:44:48.794 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-cycle-write 2023-08-25T09:44:49.169 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-eof-race 2023-08-25T09:44:49.553 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-extend-stat 2023-08-25T09:44:49.906 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-fcntl-race 2023-08-25T09:44:50.245 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-hole-filling-race 2023-08-25T09:44:50.583 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-invalidate-failure 2023-08-25T09:44:50.924 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-invalidate-readahead 2023-08-25T09:44:51.298 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aiodio_sparse2 2023-08-25T09:44:51.701 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-subblock-eof-read 2023-08-25T09:44:52.040 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-write-verify 2023-08-25T09:44:52.410 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-08-25T09:44:52.697 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-08-25T09:44:52.983 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-last-ref-held-by-io 2023-08-25T09:44:53.365 INFO:teuthology.orchestra.run.smithi149.stdout:Building vfs 2023-08-25T09:44:53.379 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] vfstest 2023-08-25T09:44:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mount-idmapped 2023-08-25T09:44:56.332 INFO:teuthology.orchestra.run.smithi149.stdout:Building m4 2023-08-25T09:44:56.343 INFO:teuthology.orchestra.run.smithi149.stdout:Building common 2023-08-25T09:44:56.354 INFO:teuthology.orchestra.run.smithi149.stdout:Building tests 2023-08-25T09:44:56.368 INFO:teuthology.orchestra.run.smithi149.stdout:Building btrfs 2023-08-25T09:44:56.384 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/btrfs/group.list 2023-08-25T09:44:56.606 INFO:teuthology.orchestra.run.smithi149.stdout:Building ceph 2023-08-25T09:44:56.620 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ceph/group.list 2023-08-25T09:44:56.676 INFO:teuthology.orchestra.run.smithi149.stdout:Building cifs 2023-08-25T09:44:56.691 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/cifs/group.list 2023-08-25T09:44:56.737 INFO:teuthology.orchestra.run.smithi149.stdout:Building ext4 2023-08-25T09:44:56.751 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ext4/group.list 2023-08-25T09:44:56.896 INFO:teuthology.orchestra.run.smithi149.stdout:Building f2fs 2023-08-25T09:44:56.911 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/f2fs/group.list 2023-08-25T09:44:56.985 INFO:teuthology.orchestra.run.smithi149.stdout:Building generic 2023-08-25T09:44:56.997 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/generic/group.list 2023-08-25T09:44:57.373 INFO:teuthology.orchestra.run.smithi149.stdout:Building nfs 2023-08-25T09:44:57.389 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/nfs/group.list 2023-08-25T09:44:57.448 INFO:teuthology.orchestra.run.smithi149.stdout:Building ocfs2 2023-08-25T09:44:57.461 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ocfs2/group.list 2023-08-25T09:44:57.510 INFO:teuthology.orchestra.run.smithi149.stdout:Building overlay 2023-08-25T09:44:57.523 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/overlay/group.list 2023-08-25T09:44:57.678 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-08-25T09:44:57.694 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/perf/group.list 2023-08-25T09:44:57.736 INFO:teuthology.orchestra.run.smithi149.stdout:Building selftest 2023-08-25T09:44:57.749 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/selftest/group.list 2023-08-25T09:44:57.796 INFO:teuthology.orchestra.run.smithi149.stdout:Building shared 2023-08-25T09:44:57.809 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/shared/group.list 2023-08-25T09:44:57.876 INFO:teuthology.orchestra.run.smithi149.stdout:Building tmpfs 2023-08-25T09:44:57.891 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/tmpfs/group.list 2023-08-25T09:44:57.943 INFO:teuthology.orchestra.run.smithi149.stdout:Building udf 2023-08-25T09:44:57.959 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/udf/group.list 2023-08-25T09:44:58.002 INFO:teuthology.orchestra.run.smithi149.stdout:Building xfs 2023-08-25T09:44:58.020 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/xfs/group.list 2023-08-25T09:44:58.415 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.pUGqPxeVwnxfstests-dev && exec sudo make install) 2023-08-25T09:44:58.542 INFO:teuthology.orchestra.run.smithi149.stdout:Building include 2023-08-25T09:44:58.553 INFO:teuthology.orchestra.run.smithi149.stdout:Building lib 2023-08-25T09:44:58.563 INFO:teuthology.orchestra.run.smithi149.stdout:Building ltp 2023-08-25T09:44:58.573 INFO:teuthology.orchestra.run.smithi149.stdout:Building src 2023-08-25T09:44:58.658 INFO:teuthology.orchestra.run.smithi149.stdout:Building log-writes 2023-08-25T09:44:58.671 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-08-25T09:44:58.681 INFO:teuthology.orchestra.run.smithi149.stdout:Building aio-dio-regress 2023-08-25T09:44:58.693 INFO:teuthology.orchestra.run.smithi149.stdout:Building vfs 2023-08-25T09:44:58.705 INFO:teuthology.orchestra.run.smithi149.stdout:Building m4 2023-08-25T09:44:58.716 INFO:teuthology.orchestra.run.smithi149.stdout:Building common 2023-08-25T09:44:58.726 INFO:teuthology.orchestra.run.smithi149.stdout:Building tests 2023-08-25T09:44:58.741 INFO:teuthology.orchestra.run.smithi149.stdout:Building btrfs 2023-08-25T09:44:58.757 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/btrfs/group.list 2023-08-25T09:44:58.987 INFO:teuthology.orchestra.run.smithi149.stdout:Building ceph 2023-08-25T09:44:59.003 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ceph/group.list 2023-08-25T09:44:59.054 INFO:teuthology.orchestra.run.smithi149.stdout:Building cifs 2023-08-25T09:44:59.068 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/cifs/group.list 2023-08-25T09:44:59.112 INFO:teuthology.orchestra.run.smithi149.stdout:Building ext4 2023-08-25T09:44:59.125 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ext4/group.list 2023-08-25T09:44:59.277 INFO:teuthology.orchestra.run.smithi149.stdout:Building f2fs 2023-08-25T09:44:59.293 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/f2fs/group.list 2023-08-25T09:44:59.361 INFO:teuthology.orchestra.run.smithi149.stdout:Building generic 2023-08-25T09:44:59.381 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/generic/group.list 2023-08-25T09:44:59.750 INFO:teuthology.orchestra.run.smithi149.stdout:Building nfs 2023-08-25T09:44:59.766 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/nfs/group.list 2023-08-25T09:44:59.822 INFO:teuthology.orchestra.run.smithi149.stdout:Building ocfs2 2023-08-25T09:44:59.838 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ocfs2/group.list 2023-08-25T09:44:59.890 INFO:teuthology.orchestra.run.smithi149.stdout:Building overlay 2023-08-25T09:44:59.906 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/overlay/group.list 2023-08-25T09:45:00.059 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-08-25T09:45:00.075 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/perf/group.list 2023-08-25T09:45:00.118 INFO:teuthology.orchestra.run.smithi149.stdout:Building selftest 2023-08-25T09:45:00.133 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/selftest/group.list 2023-08-25T09:45:00.180 INFO:teuthology.orchestra.run.smithi149.stdout:Building shared 2023-08-25T09:45:00.195 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/shared/group.list 2023-08-25T09:45:00.263 INFO:teuthology.orchestra.run.smithi149.stdout:Building tmpfs 2023-08-25T09:45:00.278 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/tmpfs/group.list 2023-08-25T09:45:00.331 INFO:teuthology.orchestra.run.smithi149.stdout:Building udf 2023-08-25T09:45:00.346 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/udf/group.list 2023-08-25T09:45:00.389 INFO:teuthology.orchestra.run.smithi149.stdout:Building xfs 2023-08-25T09:45:00.408 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/xfs/group.list 2023-08-25T09:45:00.774 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-08-25T09:45:00.778 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T09:45:00.778 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-08-25T09:45:00.783 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T09:45:00.783 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-08-25T09:45:00.788 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-08-25T09:45:00.819 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-08-25T09:45:01.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:01.020 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:01.023 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:01.056 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-08-25T09:45:01.084 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-08-25T09:45:01.119 INFO:teuthology.orchestra.run.smithi149.stdout:Building log-writes 2023-08-25T09:45:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-08-25T09:45:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:Building aio-dio-regress 2023-08-25T09:45:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:Building vfs 2023-08-25T09:45:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C log-writes install 2023-08-25T09:45:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-08-25T09:45:01.183 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-08-25T09:45:01.215 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C perf install 2023-08-25T09:45:01.219 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-08-25T09:45:01.251 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-08-25T09:45:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-08-25T09:45:01.336 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-08-25T09:45:01.369 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-08-25T09:45:01.568 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C vfs install 2023-08-25T09:45:01.572 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-08-25T09:45:01.607 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-08-25T09:45:01.654 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-08-25T09:45:01.688 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-08-25T09:45:05.925 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-08-25T09:45:06.239 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-08-25T09:45:06.302 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-08-25T09:45:06.306 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T09:45:06.307 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-08-25T09:45:06.310 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-08-25T09:45:06.341 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-08-25T09:45:06.849 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-08-25T09:45:06.853 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/btrfs/ install 2023-08-25T09:45:06.860 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-08-25T09:45:06.893 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 299 /var/lib/xfstests/tests/btrfs 2023-08-25T09:45:10.574 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-08-25T09:45:10.608 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 299.out /var/lib/xfstests/tests/btrfs 2023-08-25T09:45:13.944 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ceph/ install 2023-08-25T09:45:13.949 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-08-25T09:45:13.981 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-08-25T09:45:14.056 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-08-25T09:45:14.088 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-08-25T09:45:14.165 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/cifs/ install 2023-08-25T09:45:14.169 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-08-25T09:45:14.204 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-08-25T09:45:14.238 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-08-25T09:45:14.271 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-08-25T09:45:14.305 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ext4/ install 2023-08-25T09:45:14.310 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-08-25T09:45:14.344 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-08-25T09:45:15.090 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-08-25T09:45:15.126 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-08-25T09:45:15.879 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/f2fs/ install 2023-08-25T09:45:15.883 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-08-25T09:45:15.917 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-08-25T09:45:15.963 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-08-25T09:45:15.995 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-08-25T09:45:16.039 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/generic/ install 2023-08-25T09:45:16.050 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-08-25T09:45:16.087 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-08-25T09:45:24.561 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-08-25T09:45:24.596 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out /var/lib/xfstests/tests/generic 2023-08-25T09:45:31.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:31.142 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:31.145 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:32.152 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/nfs/ install 2023-08-25T09:45:32.156 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-08-25T09:45:32.190 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-08-25T09:45:32.224 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-08-25T09:45:32.258 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-08-25T09:45:32.291 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/ocfs2/ install 2023-08-25T09:45:32.295 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-08-25T09:45:32.330 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-08-25T09:45:32.364 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-08-25T09:45:32.398 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-08-25T09:45:32.433 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/overlay/ install 2023-08-25T09:45:32.438 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-08-25T09:45:32.471 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-08-25T09:45:33.676 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-08-25T09:45:33.712 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-08-25T09:45:34.750 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/perf/ install 2023-08-25T09:45:34.754 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-08-25T09:45:34.787 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-08-25T09:45:34.821 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-08-25T09:45:34.854 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-08-25T09:45:34.888 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/selftest/ install 2023-08-25T09:45:34.894 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-08-25T09:45:34.927 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-08-25T09:45:35.012 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-08-25T09:45:35.045 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-08-25T09:45:35.131 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/shared/ install 2023-08-25T09:45:35.135 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-08-25T09:45:35.168 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-08-25T09:45:35.222 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-08-25T09:45:35.256 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-08-25T09:45:35.311 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/tmpfs/ install 2023-08-25T09:45:35.315 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-08-25T09:45:35.349 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-08-25T09:45:35.383 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-08-25T09:45:35.417 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-08-25T09:45:35.451 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/udf/ install 2023-08-25T09:45:35.455 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-08-25T09:45:35.489 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-08-25T09:45:35.523 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-08-25T09:45:35.557 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-08-25T09:45:35.591 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pUGqPxeVwnxfstests-dev/tests/xfs/ install 2023-08-25T09:45:35.602 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-08-25T09:45:35.636 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-08-25T09:45:43.620 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-08-25T09:45:43.654 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-08-25T09:45:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-08-25T09:45:51.849 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-08-25T09:45:51.881 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-08-25T09:45:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-08-25T09:45:51.954 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.M8BcpFRYQBxfsprogs-dev && exec sudo make) 2023-08-25T09:45:52.062 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize -c -i -f 2023-08-25T09:45:52.445 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-08-25T09:45:52.445 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './config.guess' 2023-08-25T09:45:52.461 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './config.sub' 2023-08-25T09:45:52.475 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './install-sh' 2023-08-25T09:45:52.491 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './ltmain.sh' 2023-08-25T09:45:52.590 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-25T09:45:52.590 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-25T09:45:52.613 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-25T09:45:52.637 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-25T09:45:52.659 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-25T09:45:52.683 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-25T09:45:52.714 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-25T09:45:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:cp include/install-sh . 2023-08-25T09:45:52.722 INFO:teuthology.orchestra.run.smithi149.stdout:aclocal -I m4 2023-08-25T09:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:autoconf 2023-08-25T09:45:54.635 INFO:teuthology.orchestra.run.smithi149.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-08-25T09:45:54.822 INFO:teuthology.orchestra.run.smithi149.stdout:configure: loading site script /usr/share/config.site 2023-08-25T09:45:54.856 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a BSD-compatible install... /bin/install -c 2023-08-25T09:45:54.982 INFO:teuthology.orchestra.run.smithi149.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-25T09:45:54.982 INFO:teuthology.orchestra.run.smithi149.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-25T09:45:54.986 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to print strings... printf 2023-08-25T09:45:54.986 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... gcc 2023-08-25T09:45:55.102 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether the C compiler works... yes 2023-08-25T09:45:55.102 INFO:teuthology.orchestra.run.smithi149.stdout:checking for C compiler default output file name... a.out 2023-08-25T09:45:55.169 INFO:teuthology.orchestra.run.smithi149.stdout:checking for suffix of executables... 2023-08-25T09:45:55.248 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are cross compiling... no 2023-08-25T09:45:55.299 INFO:teuthology.orchestra.run.smithi149.stdout:checking for suffix of object files... o 2023-08-25T09:45:55.345 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... yes 2023-08-25T09:45:55.389 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... yes 2023-08-25T09:45:55.453 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-25T09:45:55.463 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-25T09:45:55.472 INFO:teuthology.orchestra.run.smithi149.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-25T09:45:55.480 INFO:teuthology.orchestra.run.smithi149.stdout:checking for egrep... /bin/grep -E 2023-08-25T09:45:55.484 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fgrep... /bin/grep -F 2023-08-25T09:45:55.498 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ld used by gcc... /bin/ld 2023-08-25T09:45:55.504 INFO:teuthology.orchestra.run.smithi149.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-25T09:45:55.512 INFO:teuthology.orchestra.run.smithi149.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-25T09:45:55.597 INFO:teuthology.orchestra.run.smithi149.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-25T09:45:55.597 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether ln -s works... yes 2023-08-25T09:45:55.608 INFO:teuthology.orchestra.run.smithi149.stdout:checking the maximum length of command line arguments... 1572864 2023-08-25T09:45:55.617 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-25T09:45:55.618 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-25T09:45:55.618 INFO:teuthology.orchestra.run.smithi149.stdout:checking for /bin/ld option to reload object files... -r 2023-08-25T09:45:55.619 INFO:teuthology.orchestra.run.smithi149.stdout:checking for objdump... objdump 2023-08-25T09:45:55.620 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to recognize dependent libraries... pass_all 2023-08-25T09:45:55.622 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dlltool... no 2023-08-25T09:45:55.622 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-25T09:45:55.623 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ar... ar 2023-08-25T09:45:55.715 INFO:teuthology.orchestra.run.smithi149.stdout:checking for archiver @FILE support... @ 2023-08-25T09:45:55.716 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strip... strip 2023-08-25T09:45:55.717 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ranlib... ranlib 2023-08-25T09:45:55.718 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gawk... gawk 2023-08-25T09:45:55.894 INFO:teuthology.orchestra.run.smithi149.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-25T09:45:55.898 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sysroot... no 2023-08-25T09:45:55.909 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a working dd... /bin/dd 2023-08-25T09:45:55.919 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-25T09:45:55.956 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mt... no 2023-08-25T09:45:55.964 INFO:teuthology.orchestra.run.smithi149.stdout:checking if : is a manifest tool... no 2023-08-25T09:45:56.026 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to run the C preprocessor... gcc -E 2023-08-25T09:45:56.302 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ANSI C header files... yes 2023-08-25T09:45:56.363 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/types.h... yes 2023-08-25T09:45:56.432 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/stat.h... yes 2023-08-25T09:45:56.498 INFO:teuthology.orchestra.run.smithi149.stdout:checking for stdlib.h... yes 2023-08-25T09:45:56.564 INFO:teuthology.orchestra.run.smithi149.stdout:checking for string.h... yes 2023-08-25T09:45:56.633 INFO:teuthology.orchestra.run.smithi149.stdout:checking for memory.h... yes 2023-08-25T09:45:56.702 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strings.h... yes 2023-08-25T09:45:56.772 INFO:teuthology.orchestra.run.smithi149.stdout:checking for inttypes.h... yes 2023-08-25T09:45:56.845 INFO:teuthology.orchestra.run.smithi149.stdout:checking for stdint.h... yes 2023-08-25T09:45:56.920 INFO:teuthology.orchestra.run.smithi149.stdout:checking for unistd.h... yes 2023-08-25T09:45:56.990 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dlfcn.h... yes 2023-08-25T09:45:57.002 INFO:teuthology.orchestra.run.smithi149.stdout:checking for objdir... .libs 2023-08-25T09:45:57.181 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-25T09:45:57.182 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-25T09:45:57.233 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-25T09:45:57.280 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc static flag -static works... no 2023-08-25T09:45:57.353 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -c -o file.o... yes 2023-08-25T09:45:57.353 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-25T09:45:57.376 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-25T09:45:57.440 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether -lc should be explicitly linked in... no 2023-08-25T09:45:57.572 INFO:teuthology.orchestra.run.smithi149.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-25T09:45:57.572 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to hardcode library paths into programs... immediate 2023-08-25T09:45:57.576 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether stripping libraries is possible... yes 2023-08-25T09:45:57.576 INFO:teuthology.orchestra.run.smithi149.stdout:checking if libtool supports shared libraries... yes 2023-08-25T09:45:57.576 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether to build shared libraries... yes 2023-08-25T09:45:57.577 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether to build static libraries... yes 2023-08-25T09:45:57.577 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... (cached) gcc 2023-08-25T09:45:57.621 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-25T09:45:57.631 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-25T09:45:57.632 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-25T09:45:57.637 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... (cached) gcc 2023-08-25T09:45:57.686 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-25T09:45:57.687 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-25T09:45:57.687 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-25T09:45:57.698 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... (cached) gcc 2023-08-25T09:45:57.752 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-25T09:45:57.753 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-25T09:45:57.753 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-25T09:45:57.753 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gmake... /bin/gmake 2023-08-25T09:45:57.754 INFO:teuthology.orchestra.run.smithi149.stdout:checking for tar... /bin/tar 2023-08-25T09:45:57.754 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gzip... /bin/gzip 2023-08-25T09:45:57.780 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc -MM is supported... yes 2023-08-25T09:45:57.780 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sort... /bin/sort 2023-08-25T09:45:57.781 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether ln -s works... yes 2023-08-25T09:45:57.781 INFO:teuthology.orchestra.run.smithi149.stdout:checking for msgfmt... /bin/msgfmt 2023-08-25T09:45:57.781 INFO:teuthology.orchestra.run.smithi149.stdout:checking for msgmerge... /bin/msgmerge 2023-08-25T09:45:57.781 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xgettext... /bin/xgettext 2023-08-25T09:45:57.782 INFO:teuthology.orchestra.run.smithi149.stdout:checking for rpm... /bin/rpm 2023-08-25T09:45:57.791 INFO:teuthology.orchestra.run.smithi149.stdout:checking for rpmbuild... no 2023-08-25T09:45:57.854 INFO:teuthology.orchestra.run.smithi149.stdout:checking ini.h usability... yes 2023-08-25T09:45:57.881 INFO:teuthology.orchestra.run.smithi149.stdout:checking ini.h presence... yes 2023-08-25T09:45:57.881 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ini.h... yes 2023-08-25T09:45:57.958 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ini_parse in -linih... yes 2023-08-25T09:45:58.027 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid.h usability... no 2023-08-25T09:45:58.068 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid.h presence... no 2023-08-25T09:45:58.068 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid.h... no 2023-08-25T09:45:58.142 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/uuid.h usability... no 2023-08-25T09:45:58.182 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/uuid.h presence... no 2023-08-25T09:45:58.183 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/uuid.h... no 2023-08-25T09:45:58.250 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid/uuid.h usability... yes 2023-08-25T09:45:58.280 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid/uuid.h presence... yes 2023-08-25T09:45:58.281 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid/uuid.h... yes 2023-08-25T09:45:58.382 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid_compare... no 2023-08-25T09:45:58.463 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid_compare in -luuid... yes 2023-08-25T09:45:58.530 INFO:teuthology.orchestra.run.smithi149.stdout:checking pthread.h usability... yes 2023-08-25T09:45:58.560 INFO:teuthology.orchestra.run.smithi149.stdout:checking pthread.h presence... yes 2023-08-25T09:45:58.561 INFO:teuthology.orchestra.run.smithi149.stdout:checking for pthread.h... yes 2023-08-25T09:45:58.645 INFO:teuthology.orchestra.run.smithi149.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-08-25T09:45:58.717 INFO:teuthology.orchestra.run.smithi149.stdout:checking urcu.h usability... yes 2023-08-25T09:45:58.759 INFO:teuthology.orchestra.run.smithi149.stdout:checking urcu.h presence... yes 2023-08-25T09:45:58.759 INFO:teuthology.orchestra.run.smithi149.stdout:checking for urcu.h... yes 2023-08-25T09:45:58.831 INFO:teuthology.orchestra.run.smithi149.stdout:checking for liburcu... yes 2023-08-25T09:45:58.883 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fadvise ... yes 2023-08-25T09:45:58.931 INFO:teuthology.orchestra.run.smithi149.stdout:checking for madvise ... yes 2023-08-25T09:45:58.979 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mincore ... yes 2023-08-25T09:45:59.044 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sendfile ... yes 2023-08-25T09:45:59.097 INFO:teuthology.orchestra.run.smithi149.stdout:checking for getmntent ... yes 2023-08-25T09:45:59.184 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fallocate... yes 2023-08-25T09:45:59.267 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fiemap... yes 2023-08-25T09:45:59.352 INFO:teuthology.orchestra.run.smithi149.stdout:checking for pwritev2... yes 2023-08-25T09:45:59.437 INFO:teuthology.orchestra.run.smithi149.stdout:checking for preadv... yes 2023-08-25T09:45:59.515 INFO:teuthology.orchestra.run.smithi149.stdout:checking for copy_file_range... yes 2023-08-25T09:45:59.599 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sync_file_range... yes 2023-08-25T09:45:59.686 INFO:teuthology.orchestra.run.smithi149.stdout:checking for syncfs... yes 2023-08-25T09:45:59.747 INFO:teuthology.orchestra.run.smithi149.stdout:checking mntent.h usability... yes 2023-08-25T09:45:59.774 INFO:teuthology.orchestra.run.smithi149.stdout:checking mntent.h presence... yes 2023-08-25T09:45:59.774 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mntent.h... yes 2023-08-25T09:45:59.840 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether fls is declared... no 2023-08-25T09:45:59.923 INFO:teuthology.orchestra.run.smithi149.stdout:checking for readdir... yes 2023-08-25T09:45:59.989 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether fsetxattr is declared... yes 2023-08-25T09:46:00.052 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether mremap is declared... yes 2023-08-25T09:46:00.140 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct fsxattr... yes 2023-08-25T09:46:00.193 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-08-25T09:46:00.290 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct fscrypt_add_key_arg... yes 2023-08-25T09:46:00.345 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-08-25T09:46:00.439 INFO:teuthology.orchestra.run.smithi149.stdout:checking for GETFSMAP... yes 2023-08-25T09:46:00.537 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct statfs... yes 2023-08-25T09:46:00.589 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct statfs.f_flags... yes 2023-08-25T09:46:00.638 INFO:teuthology.orchestra.run.smithi149.stdout:checking for MAP_SYNC... yes 2023-08-25T09:46:00.820 INFO:teuthology.orchestra.run.smithi149.stdout:checking for library containing dm_task_create... -ldevmapper 2023-08-25T09:46:00.883 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mallinfo ... yes 2023-08-25T09:46:00.940 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mallinfo2 ... yes 2023-08-25T09:46:00.999 INFO:teuthology.orchestra.run.smithi149.stdout:checking attr/attributes.h usability... yes 2023-08-25T09:46:01.029 INFO:teuthology.orchestra.run.smithi149.stdout:checking attr/attributes.h presence... yes 2023-08-25T09:46:01.029 INFO:teuthology.orchestra.run.smithi149.stdout:checking for attr/attributes.h... yes 2023-08-25T09:46:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct attrlist_cursor... yes 2023-08-25T09:46:01.091 INFO:teuthology.orchestra.run.smithi149.stdout:checking for pkg-config... /bin/pkg-config 2023-08-25T09:46:01.109 INFO:teuthology.orchestra.run.smithi149.stdout:checking pkg-config is at least version 0.9.0... yes 2023-08-25T09:46:01.191 INFO:teuthology.orchestra.run.smithi149.stdout:checking for libicu... yes 2023-08-25T09:46:01.260 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether openat is declared... yes 2023-08-25T09:46:01.277 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:01.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:01.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether fstatat is declared... yes 2023-08-25T09:46:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct sg_io_hdr ... yes 2023-08-25T09:46:01.437 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct hd_geometry ... yes 2023-08-25T09:46:01.514 INFO:teuthology.orchestra.run.smithi149.stdout:checking for systemd... yes 2023-08-25T09:46:01.531 INFO:teuthology.orchestra.run.smithi149.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-08-25T09:46:01.532 INFO:teuthology.orchestra.run.smithi149.stdout:checking for system crontab dir... /etc/cron.d 2023-08-25T09:46:01.717 INFO:teuthology.orchestra.run.smithi149.stdout:checking for library containing blkid_probe_all... -lblkid 2023-08-25T09:46:01.806 INFO:teuthology.orchestra.run.smithi149.stdout:checking for blkid_probe_get_topology... yes 2023-08-25T09:46:01.922 INFO:teuthology.orchestra.run.smithi149.stdout:checking size of long... 8 2023-08-25T09:46:02.033 INFO:teuthology.orchestra.run.smithi149.stdout:checking size of char *... 8 2023-08-25T09:46:02.078 INFO:teuthology.orchestra.run.smithi149.stdout:checking for umode_t... no 2023-08-25T09:46:02.189 INFO:teuthology.orchestra.run.smithi149.stdout:checking for atomic64_t support in liburcu... yes 2023-08-25T09:46:02.228 INFO:teuthology.orchestra.run.smithi149.stdout:configure: creating ./config.status 2023-08-25T09:46:03.462 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: creating include/builddefs 2023-08-25T09:46:03.496 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: creating include/platform_defs.h 2023-08-25T09:46:03.524 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: executing libtool commands 2023-08-25T09:46:03.646 INFO:teuthology.orchestra.run.smithi149.stdout: [HEADERS] include 2023-08-25T09:46:03.670 INFO:teuthology.orchestra.run.smithi149.stdout: [HEADERS] libxfs 2023-08-25T09:46:03.712 INFO:teuthology.orchestra.run.smithi149.stdout:Building include 2023-08-25T09:46:03.727 INFO:teuthology.orchestra.run.smithi149.stdout: [LN] disk 2023-08-25T09:46:03.734 INFO:teuthology.orchestra.run.smithi149.stdout:Building libfrog 2023-08-25T09:46:03.744 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] gen_crc32table 2023-08-25T09:46:03.834 INFO:teuthology.orchestra.run.smithi149.stdout: [GENERATE] crc32table.h 2023-08-25T09:46:04.564 INFO:teuthology.orchestra.run.smithi149.stdout: [TEST] CRC32 2023-08-25T09:46:04.767 INFO:teuthology.orchestra.run.smithi149.stdout:CRC_LE_BITS = 64 2023-08-25T09:46:04.767 INFO:teuthology.orchestra.run.smithi149.stdout:crc32c: tests passed, 225944 bytes in 81 usec 2023-08-25T09:46:04.772 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] avl64.lo 2023-08-25T09:46:05.520 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bitmap.lo 2023-08-25T09:46:06.125 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat.lo 2023-08-25T09:46:06.798 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] convert.lo 2023-08-25T09:46:07.420 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] crc32.lo 2023-08-25T09:46:07.867 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsgeom.lo 2023-08-25T09:46:08.445 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] list_sort.lo 2023-08-25T09:46:08.903 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] linux.lo 2023-08-25T09:46:09.486 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] logging.lo 2023-08-25T09:46:09.855 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] paths.lo 2023-08-25T09:46:10.527 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] projects.lo 2023-08-25T09:46:11.113 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] ptvar.lo 2023-08-25T09:46:11.657 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] radix-tree.lo 2023-08-25T09:46:12.481 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] randbytes.lo 2023-08-25T09:46:12.916 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] scrub.lo 2023-08-25T09:46:13.365 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] util.lo 2023-08-25T09:46:13.815 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] workqueue.lo 2023-08-25T09:46:14.318 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] libfrog.la 2023-08-25T09:46:14.542 INFO:teuthology.orchestra.run.smithi149.stdout:Building libxfs 2023-08-25T09:46:16.953 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] cache.lo 2023-08-25T09:46:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] defer_item.lo 2023-08-25T09:46:18.469 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] init.lo 2023-08-25T09:46:19.478 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] kmem.lo 2023-08-25T09:46:20.025 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] logitem.lo 2023-08-25T09:46:20.609 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] rdwr.lo 2023-08-25T09:46:21.817 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] topology.lo 2023-08-25T09:46:22.451 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] trans.lo 2023-08-25T09:46:23.249 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] util.lo 2023-08-25T09:46:24.065 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_ag.lo 2023-08-25T09:46:25.181 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_ag_resv.lo 2023-08-25T09:46:25.801 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_alloc.lo 2023-08-25T09:46:27.587 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_alloc_btree.lo 2023-08-25T09:46:28.409 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_attr.lo 2023-08-25T09:46:29.338 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_attr_leaf.lo 2023-08-25T09:46:31.056 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_attr_remote.lo 2023-08-25T09:46:31.409 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:31.412 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:31.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:31.859 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_bit.lo 2023-08-25T09:46:32.407 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_bmap.lo 2023-08-25T09:46:35.460 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_bmap_btree.lo 2023-08-25T09:46:36.280 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_btree.lo 2023-08-25T09:46:38.755 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_btree_staging.lo 2023-08-25T09:46:39.454 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_da_btree.lo 2023-08-25T09:46:41.021 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_defer.lo 2023-08-25T09:46:41.859 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dir2.lo 2023-08-25T09:46:42.645 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dir2_block.lo 2023-08-25T09:46:43.823 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dir2_data.lo 2023-08-25T09:46:44.885 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dir2_leaf.lo 2023-08-25T09:46:46.143 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dir2_node.lo 2023-08-25T09:46:47.468 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dir2_sf.lo 2023-08-25T09:46:48.525 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_dquot_buf.lo 2023-08-25T09:46:49.184 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_ialloc.lo 2023-08-25T09:46:50.803 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_iext_tree.lo 2023-08-25T09:46:51.771 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_inode_buf.lo 2023-08-25T09:46:52.717 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_inode_fork.lo 2023-08-25T09:46:53.607 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_ialloc_btree.lo 2023-08-25T09:46:54.480 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_log_rlimit.lo 2023-08-25T09:46:55.083 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_refcount.lo 2023-08-25T09:46:56.214 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_refcount_btree.lo 2023-08-25T09:46:56.974 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_rmap.lo 2023-08-25T09:46:58.472 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_rmap_btree.lo 2023-08-25T09:46:59.361 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_rtbitmap.lo 2023-08-25T09:47:00.257 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_sb.lo 2023-08-25T09:47:01.417 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_symlink_remote.lo 2023-08-25T09:47:01.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:01.552 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:01.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:02.029 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_trans_inode.lo 2023-08-25T09:47:02.555 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_trans_resv.lo 2023-08-25T09:47:03.391 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_types.lo 2023-08-25T09:47:04.030 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] libxfs.la 2023-08-25T09:47:04.364 INFO:teuthology.orchestra.run.smithi149.stdout:Building libxlog 2023-08-25T09:47:04.500 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_log_recover.lo 2023-08-25T09:47:05.638 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] util.lo 2023-08-25T09:47:06.227 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] libxlog.la 2023-08-25T09:47:06.427 INFO:teuthology.orchestra.run.smithi149.stdout:Building libxcmd 2023-08-25T09:47:06.617 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] command.lo 2023-08-25T09:47:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] input.lo 2023-08-25T09:47:07.795 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] help.lo 2023-08-25T09:47:08.267 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] quit.lo 2023-08-25T09:47:08.731 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] libxcmd.la 2023-08-25T09:47:08.934 INFO:teuthology.orchestra.run.smithi149.stdout:Building libhandle 2023-08-25T09:47:09.053 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] handle.lo 2023-08-25T09:47:09.706 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] jdm.lo 2023-08-25T09:47:10.239 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] libhandle.la 2023-08-25T09:47:10.503 INFO:teuthology.orchestra.run.smithi149.stdout:Building copy 2023-08-25T09:47:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_copy.o 2023-08-25T09:47:11.089 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_copy 2023-08-25T09:47:11.334 INFO:teuthology.orchestra.run.smithi149.stdout:Building db 2023-08-25T09:47:14.254 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] addr.o 2023-08-25T09:47:14.407 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] agf.o 2023-08-25T09:47:14.555 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] agfl.o 2023-08-25T09:47:14.700 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] agi.o 2023-08-25T09:47:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr.o 2023-08-25T09:47:15.086 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attrshort.o 2023-08-25T09:47:15.250 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bit.o 2023-08-25T09:47:15.412 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] block.o 2023-08-25T09:47:15.577 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bmap.o 2023-08-25T09:47:15.826 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] btblock.o 2023-08-25T09:47:16.002 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bmroot.o 2023-08-25T09:47:16.217 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] check.o 2023-08-25T09:47:18.091 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] command.o 2023-08-25T09:47:18.235 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] crc.o 2023-08-25T09:47:18.383 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] debug.o 2023-08-25T09:47:18.504 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dir2.o 2023-08-25T09:47:18.828 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dir2sf.o 2023-08-25T09:47:19.009 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dquot.o 2023-08-25T09:47:19.154 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] echo.o 2023-08-25T09:47:19.286 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] faddr.o 2023-08-25T09:47:19.515 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] field.o 2023-08-25T09:47:19.670 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] flist.o 2023-08-25T09:47:19.939 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fprint.o 2023-08-25T09:47:20.149 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] frag.o 2023-08-25T09:47:20.425 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] freesp.o 2023-08-25T09:47:20.656 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] hash.o 2023-08-25T09:47:20.748 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c: In function ‘hash_f’: 2023-08-25T09:47:20.748 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of ‘libxfs_da_hashname’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.748 INFO:teuthology.orchestra.run.smithi149.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-08-25T09:47:20.749 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~^~~ 2023-08-25T09:47:20.749 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.749 INFO:teuthology.orchestra.run.smithi149.stderr: | char * 2023-08-25T09:47:20.749 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/libxfs.h:59, 2023-08-25T09:47:20.750 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.750 INFO:teuthology.orchestra.run.smithi149.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected ‘const uint8_t *’ {aka ‘const unsigned char *’} but argument is of type ‘char *’ 2023-08-25T09:47:20.750 INFO:teuthology.orchestra.run.smithi149.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-08-25T09:47:20.750 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-08-25T09:47:20.750 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c: In function ‘collide_dirents’: 2023-08-25T09:47:20.751 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of ‘openat’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.751 INFO:teuthology.orchestra.run.smithi149.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-08-25T09:47:20.751 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~ 2023-08-25T09:47:20.751 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.752 INFO:teuthology.orchestra.run.smithi149.stderr: | const unsigned char * 2023-08-25T09:47:20.752 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from /usr/include/features.h:490, 2023-08-25T09:47:20.752 INFO:teuthology.orchestra.run.smithi149.stderr: from /usr/include/bits/libc-header-start.h:33, 2023-08-25T09:47:20.752 INFO:teuthology.orchestra.run.smithi149.stderr: from /usr/include/stdio.h:27, 2023-08-25T09:47:20.752 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/platform_defs.h:10, 2023-08-25T09:47:20.752 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/fcntl.h:237:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr: 237 | extern int __REDIRECT (openat, (int __fd, const char *__file, int __oflag, 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~~ 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-08-25T09:47:20.753 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~~ 2023-08-25T09:47:20.754 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.754 INFO:teuthology.orchestra.run.smithi149.stderr: | unsigned char * 2023-08-25T09:47:20.755 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/platform_defs.h:17, 2023-08-25T09:47:20.755 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.755 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.755 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/string.h:128:40: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-08-25T09:47:20.756 INFO:teuthology.orchestra.run.smithi149.stderr: 128 | extern char *strncpy (char *__restrict __dest, 2023-08-25T09:47:20.756 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~^~~~~~ 2023-08-25T09:47:20.756 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.757 INFO:teuthology.orchestra.run.smithi149.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-08-25T09:47:20.757 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~ 2023-08-25T09:47:20.757 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.757 INFO:teuthology.orchestra.run.smithi149.stderr: | const unsigned char * 2023-08-25T09:47:20.757 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/platform_defs.h:17, 2023-08-25T09:47:20.758 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.758 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.758 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/string.h:129:46: note: expected ‘const char * restrict’ but argument is of type ‘const unsigned char *’ 2023-08-25T09:47:20.759 INFO:teuthology.orchestra.run.smithi149.stderr: 129 | const char *__restrict __src, size_t __n) 2023-08-25T09:47:20.759 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~^~~~~ 2023-08-25T09:47:20.759 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.759 INFO:teuthology.orchestra.run.smithi149.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-08-25T09:47:20.759 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~ 2023-08-25T09:47:20.759 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.760 INFO:teuthology.orchestra.run.smithi149.stderr: | const unsigned char * 2023-08-25T09:47:20.760 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/platform_defs.h:19, 2023-08-25T09:47:20.760 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.760 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.761 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/unistd.h:825:46: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-08-25T09:47:20.761 INFO:teuthology.orchestra.run.smithi149.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-08-25T09:47:20.761 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-08-25T09:47:20.761 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.761 INFO:teuthology.orchestra.run.smithi149.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~~ 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr: | unsigned char * 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/platform_defs.h:19, 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/unistd.h:826:32: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-08-25T09:47:20.762 INFO:teuthology.orchestra.run.smithi149.stderr: 826 | const char *__to, int __flags) 2023-08-25T09:47:20.763 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~^~~~ 2023-08-25T09:47:20.763 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c: In function ‘collide_xattrs’: 2023-08-25T09:47:20.763 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.763 INFO:teuthology.orchestra.run.smithi149.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-08-25T09:47:20.763 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~ 2023-08-25T09:47:20.763 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr: | unsigned char * 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/platform_defs.h:10, 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-08-25T09:47:20.764 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~ 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr: | unsigned char * 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from hash.c:16: 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-08-25T09:47:20.765 INFO:teuthology.orchestra.run.smithi149.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~ 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr: | unsigned char * 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from ../include/platform_defs.h:10, 2023-08-25T09:47:20.766 INFO:teuthology.orchestra.run.smithi149.stderr: from ../include/libxfs.h:11, 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr: from hash.c:7: 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-08-25T09:47:20.767 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~~~~~~~ 2023-08-25T09:47:20.768 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.768 INFO:teuthology.orchestra.run.smithi149.stderr: | unsigned char * 2023-08-25T09:47:20.768 INFO:teuthology.orchestra.run.smithi149.stderr:In file included from hash.c:16: 2023-08-25T09:47:20.768 INFO:teuthology.orchestra.run.smithi149.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-08-25T09:47:20.768 INFO:teuthology.orchestra.run.smithi149.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-08-25T09:47:20.768 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c: In function ‘hashcoll_f’: 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~ 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr: | char * 2023-08-25T09:47:20.769 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-08-25T09:47:20.770 INFO:teuthology.orchestra.run.smithi149.stderr: 300 | const unsigned char *name, 2023-08-25T09:47:20.770 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-08-25T09:47:20.770 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.770 INFO:teuthology.orchestra.run.smithi149.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-08-25T09:47:20.770 INFO:teuthology.orchestra.run.smithi149.stderr: | ^~~ 2023-08-25T09:47:20.770 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.771 INFO:teuthology.orchestra.run.smithi149.stderr: | char * 2023-08-25T09:47:20.771 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-08-25T09:47:20.771 INFO:teuthology.orchestra.run.smithi149.stderr: 234 | const unsigned char *name, 2023-08-25T09:47:20.771 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-08-25T09:47:20.771 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.771 INFO:teuthology.orchestra.run.smithi149.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~^~~ 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr: | char * 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr: 300 | const unsigned char *name, 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-08-25T09:47:20.772 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-08-25T09:47:20.773 INFO:teuthology.orchestra.run.smithi149.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-08-25T09:47:20.773 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~^~~ 2023-08-25T09:47:20.773 INFO:teuthology.orchestra.run.smithi149.stderr: | | 2023-08-25T09:47:20.773 INFO:teuthology.orchestra.run.smithi149.stderr: | char * 2023-08-25T09:47:20.773 INFO:teuthology.orchestra.run.smithi149.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-08-25T09:47:20.773 INFO:teuthology.orchestra.run.smithi149.stderr: 234 | const unsigned char *name, 2023-08-25T09:47:20.774 INFO:teuthology.orchestra.run.smithi149.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-08-25T09:47:20.853 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] help.o 2023-08-25T09:47:20.980 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] init.o 2023-08-25T09:47:21.152 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] inode.o 2023-08-25T09:47:21.465 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] input.o 2023-08-25T09:47:21.644 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] io.o 2023-08-25T09:47:21.896 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] logformat.o 2023-08-25T09:47:22.060 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] malloc.o 2023-08-25T09:47:22.201 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] metadump.o 2023-08-25T09:47:23.068 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] output.o 2023-08-25T09:47:23.210 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] print.o 2023-08-25T09:47:23.410 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] quit.o 2023-08-25T09:47:23.537 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] sb.o 2023-08-25T09:47:23.842 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] sig.o 2023-08-25T09:47:23.969 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] strvec.o 2023-08-25T09:47:24.118 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] text.o 2023-08-25T09:47:24.258 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] type.o 2023-08-25T09:47:24.425 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] write.o 2023-08-25T09:47:24.718 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attrset.o 2023-08-25T09:47:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] symlink.o 2023-08-25T09:47:25.031 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsmap.o 2023-08-25T09:47:25.201 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fuzz.o 2023-08-25T09:47:25.417 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] obfuscate.o 2023-08-25T09:47:25.605 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] btdump.o 2023-08-25T09:47:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] btheight.o 2023-08-25T09:47:26.033 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] convert.o 2023-08-25T09:47:26.213 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] info.o 2023-08-25T09:47:26.377 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] namei.o 2023-08-25T09:47:26.643 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] timelimit.o 2023-08-25T09:47:26.795 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_db 2023-08-25T09:47:27.118 INFO:teuthology.orchestra.run.smithi149.stdout:Building estimate 2023-08-25T09:47:27.195 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_estimate.o 2023-08-25T09:47:27.372 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_estimate 2023-08-25T09:47:27.497 INFO:teuthology.orchestra.run.smithi149.stdout:Building fsck 2023-08-25T09:47:27.509 INFO:teuthology.orchestra.run.smithi149.stdout:Building fsr 2023-08-25T09:47:27.594 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_fsr.o 2023-08-25T09:47:28.079 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_fsr 2023-08-25T09:47:28.263 INFO:teuthology.orchestra.run.smithi149.stdout:Building growfs 2023-08-25T09:47:28.346 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_growfs.o 2023-08-25T09:47:28.567 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_growfs 2023-08-25T09:47:28.824 INFO:teuthology.orchestra.run.smithi149.stdout:Building io 2023-08-25T09:47:30.843 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] init.o 2023-08-25T09:47:30.980 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr.o 2023-08-25T09:47:31.154 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bmap.o 2023-08-25T09:47:31.362 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat.o 2023-08-25T09:47:31.555 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] crc32cselftest.o 2023-08-25T09:47:31.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:31.665 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] cowextsize.o 2023-08-25T09:47:31.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:31.670 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:31.803 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] encrypt.o 2023-08-25T09:47:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] file.o 2023-08-25T09:47:32.184 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] freeze.o 2023-08-25T09:47:32.292 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsuuid.o 2023-08-25T09:47:32.427 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsync.o 2023-08-25T09:47:32.530 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] getrusage.o 2023-08-25T09:47:32.648 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] imap.o 2023-08-25T09:47:32.757 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] inject.o 2023-08-25T09:47:32.878 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] label.o 2023-08-25T09:47:33.024 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] link.o 2023-08-25T09:47:33.129 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmap.o 2023-08-25T09:47:33.374 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] open.o 2023-08-25T09:47:33.685 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] parent.o 2023-08-25T09:47:33.870 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] pread.o 2023-08-25T09:47:34.075 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] prealloc.o 2023-08-25T09:47:34.234 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] pwrite.o 2023-08-25T09:47:34.421 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] reflink.o 2023-08-25T09:47:34.579 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] resblks.o 2023-08-25T09:47:34.688 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] scrub.o 2023-08-25T09:47:34.849 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] seek.o 2023-08-25T09:47:34.981 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] shutdown.o 2023-08-25T09:47:35.081 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] stat.o 2023-08-25T09:47:35.315 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] swapext.o 2023-08-25T09:47:35.419 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] sync.o 2023-08-25T09:47:35.512 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] truncate.o 2023-08-25T09:47:35.606 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] utimes.o 2023-08-25T09:47:35.701 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fadvise.o 2023-08-25T09:47:35.806 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] madvise.o 2023-08-25T09:47:35.921 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mincore.o 2023-08-25T09:47:36.034 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] sendfile.o 2023-08-25T09:47:36.153 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fiemap.o 2023-08-25T09:47:36.332 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] copy_file_range.o 2023-08-25T09:47:36.457 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] sync_file_range.o 2023-08-25T09:47:36.560 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] readdir.o 2023-08-25T09:47:36.675 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_writes.o 2023-08-25T09:47:36.789 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsmap.o 2023-08-25T09:47:37.054 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_io 2023-08-25T09:47:37.315 INFO:teuthology.orchestra.run.smithi149.stdout:Building logprint 2023-08-25T09:47:37.726 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] logprint.o 2023-08-25T09:47:37.906 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_copy.o 2023-08-25T09:47:38.049 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_dump.o 2023-08-25T09:47:38.208 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_misc.o 2023-08-25T09:47:38.756 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_print_all.o 2023-08-25T09:47:39.033 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_print_trans.o 2023-08-25T09:47:39.177 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] log_redo.o 2023-08-25T09:47:39.459 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_logprint 2023-08-25T09:47:39.712 INFO:teuthology.orchestra.run.smithi149.stdout:Building mkfs 2023-08-25T09:47:39.847 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] proto.o 2023-08-25T09:47:40.180 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_mkfs.o 2023-08-25T09:47:40.909 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] mkfs.xfs 2023-08-25T09:47:41.158 INFO:teuthology.orchestra.run.smithi149.stdout:Building quota 2023-08-25T09:47:41.707 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] init.o 2023-08-25T09:47:41.835 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] util.o 2023-08-25T09:47:42.031 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] edit.o 2023-08-25T09:47:42.260 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] free.o 2023-08-25T09:47:42.430 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] linux.o 2023-08-25T09:47:42.528 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] path.o 2023-08-25T09:47:42.666 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] project.o 2023-08-25T09:47:42.838 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] quot.o 2023-08-25T09:47:43.016 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] quota.o 2023-08-25T09:47:43.217 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] report.o 2023-08-25T09:47:43.482 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] state.o 2023-08-25T09:47:43.691 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_quota 2023-08-25T09:47:43.885 INFO:teuthology.orchestra.run.smithi149.stdout:Building mdrestore 2023-08-25T09:47:43.967 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_mdrestore.o 2023-08-25T09:47:44.165 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_mdrestore 2023-08-25T09:47:44.391 INFO:teuthology.orchestra.run.smithi149.stdout:Building repair 2023-08-25T09:47:46.314 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] agheader.o 2023-08-25T09:47:46.580 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] agbtree.o 2023-08-25T09:47:46.869 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr_repair.o 2023-08-25T09:47:47.276 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] avl.o 2023-08-25T09:47:47.512 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkload.o 2023-08-25T09:47:47.663 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bmap.o 2023-08-25T09:47:47.835 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] btree.o 2023-08-25T09:47:48.235 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] da_util.o 2023-08-25T09:47:48.504 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dino_chunks.o 2023-08-25T09:47:48.913 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dinode.o 2023-08-25T09:47:49.708 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dir2.o 2023-08-25T09:47:50.156 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] globals.o 2023-08-25T09:47:50.276 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] incore_bmc.o 2023-08-25T09:47:50.405 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] incore.o 2023-08-25T09:47:50.591 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] incore_ext.o 2023-08-25T09:47:50.843 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] incore_ino.o 2023-08-25T09:47:51.163 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] init.o 2023-08-25T09:47:51.325 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase1.o 2023-08-25T09:47:51.481 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase2.o 2023-08-25T09:47:51.698 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase3.o 2023-08-25T09:47:51.871 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase4.o 2023-08-25T09:47:52.100 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase5.o 2023-08-25T09:47:52.408 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase6.o 2023-08-25T09:47:53.326 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase7.o 2023-08-25T09:47:53.487 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] prefetch.o 2023-08-25T09:47:53.885 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] progress.o 2023-08-25T09:47:54.110 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] quotacheck.o 2023-08-25T09:47:54.338 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] rmap.o 2023-08-25T09:47:54.790 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] rt.o 2023-08-25T09:47:54.978 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] sb.o 2023-08-25T09:47:55.219 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] scan.o 2023-08-25T09:47:56.025 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] slab.o 2023-08-25T09:47:56.216 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] threads.o 2023-08-25T09:47:56.343 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] versions.o 2023-08-25T09:47:56.489 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_repair.o 2023-08-25T09:47:56.849 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_repair 2023-08-25T09:47:57.162 INFO:teuthology.orchestra.run.smithi149.stdout:Building rtcp 2023-08-25T09:47:57.239 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_rtcp.o 2023-08-25T09:47:57.447 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_rtcp 2023-08-25T09:47:57.600 INFO:teuthology.orchestra.run.smithi149.stdout:Building m4 2023-08-25T09:47:57.611 INFO:teuthology.orchestra.run.smithi149.stdout:Building man 2023-08-25T09:47:57.626 INFO:teuthology.orchestra.run.smithi149.stdout:Building man2 2023-08-25T09:47:57.643 INFO:teuthology.orchestra.run.smithi149.stdout:Building man3 2023-08-25T09:47:57.657 INFO:teuthology.orchestra.run.smithi149.stdout:Building man5 2023-08-25T09:47:57.672 INFO:teuthology.orchestra.run.smithi149.stdout:Building man8 2023-08-25T09:47:57.702 INFO:teuthology.orchestra.run.smithi149.stdout: [SED] mkfs.xfs.8 2023-08-25T09:47:57.715 INFO:teuthology.orchestra.run.smithi149.stdout:Building doc 2023-08-25T09:47:57.744 INFO:teuthology.orchestra.run.smithi149.stdout: [ZIP] CHANGES.gz 2023-08-25T09:47:57.750 INFO:teuthology.orchestra.run.smithi149.stdout:Building debian 2023-08-25T09:47:57.761 INFO:teuthology.orchestra.run.smithi149.stdout:Building spaceman 2023-08-25T09:47:58.168 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] info.o 2023-08-25T09:47:58.303 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] init.o 2023-08-25T09:47:58.457 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] file.o 2023-08-25T09:47:58.607 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] health.o 2023-08-25T09:47:58.805 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] prealloc.o 2023-08-25T09:47:58.949 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] trim.o 2023-08-25T09:47:59.100 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] freesp.o 2023-08-25T09:47:59.319 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_spaceman 2023-08-25T09:47:59.506 INFO:teuthology.orchestra.run.smithi149.stdout:Building scrub 2023-08-25T09:48:00.564 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] common.o 2023-08-25T09:48:00.738 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] counter.o 2023-08-25T09:48:00.834 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] descr.o 2023-08-25T09:48:00.946 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] disk.o 2023-08-25T09:48:01.097 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] filemap.o 2023-08-25T09:48:01.217 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fscounters.o 2023-08-25T09:48:01.347 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] inodes.o 2023-08-25T09:48:01.526 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase1.o 2023-08-25T09:48:01.661 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase2.o 2023-08-25T09:48:01.788 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase3.o 2023-08-25T09:48:01.927 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase4.o 2023-08-25T09:48:01.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:02.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:02.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:02.049 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase5.o 2023-08-25T09:48:02.219 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase6.o 2023-08-25T09:48:02.443 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] phase7.o 2023-08-25T09:48:02.587 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] progress.o 2023-08-25T09:48:02.722 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] read_verify.o 2023-08-25T09:48:02.878 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] repair.o 2023-08-25T09:48:03.038 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] scrub.o 2023-08-25T09:48:03.276 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] spacemap.o 2023-08-25T09:48:03.420 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] vfs.o 2023-08-25T09:48:03.572 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfs_scrub.o 2023-08-25T09:48:03.812 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] unicrash.o 2023-08-25T09:48:04.031 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] xfs_scrub 2023-08-25T09:48:04.425 INFO:teuthology.orchestra.run.smithi149.stdout: [SED] xfs_scrub_all 2023-08-25T09:48:04.438 INFO:teuthology.orchestra.run.smithi149.stdout: [SED] xfs_scrub@.service 2023-08-25T09:48:04.448 INFO:teuthology.orchestra.run.smithi149.stdout: [SED] xfs_scrub_all.service 2023-08-25T09:48:04.459 INFO:teuthology.orchestra.run.smithi149.stdout: [SED] xfs_scrub_fail@.service 2023-08-25T09:48:04.470 INFO:teuthology.orchestra.run.smithi149.stdout: [SED] xfs_scrub_all.cron 2023-08-25T09:48:04.481 INFO:teuthology.orchestra.run.smithi149.stdout:Building po 2023-08-25T09:48:04.522 INFO:teuthology.orchestra.run.smithi149.stdout: [GETTXT] xfsprogs.pot 2023-08-25T09:48:04.714 INFO:teuthology.orchestra.run.smithi149.stdout: [MSGFMT] de.mo 2023-08-25T09:48:04.754 INFO:teuthology.orchestra.run.smithi149.stderr:2345 translated messages. 2023-08-25T09:48:04.760 INFO:teuthology.orchestra.run.smithi149.stdout: [MSGFMT] pl.mo 2023-08-25T09:48:04.807 INFO:teuthology.orchestra.run.smithi149.stderr:3104 translated messages. 2023-08-25T09:48:04.808 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[2]: Nothing to be done for 'include'. 2023-08-25T09:48:04.816 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.M8BcpFRYQBxfsprogs-dev && exec sudo make install) 2023-08-25T09:48:04.935 INFO:teuthology.orchestra.run.smithi149.stdout:Installing libfrog-install 2023-08-25T09:48:05.577 INFO:teuthology.orchestra.run.smithi149.stdout:Installing libxfs-install 2023-08-25T09:48:07.993 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-08-25T09:48:08.028 INFO:teuthology.orchestra.run.smithi149.stdout:Installing libxlog-install 2023-08-25T09:48:08.146 INFO:teuthology.orchestra.run.smithi149.stdout:Installing libxcmd-install 2023-08-25T09:48:08.324 INFO:teuthology.orchestra.run.smithi149.stdout:Installing libhandle-install 2023-08-25T09:48:08.430 INFO:teuthology.orchestra.run.smithi149.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-08-25T09:48:08.537 INFO:teuthology.orchestra.run.smithi149.stdout:Installing copy-install 2023-08-25T09:48:08.611 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:08.644 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-08-25T09:48:08.728 INFO:teuthology.orchestra.run.smithi149.stdout:Installing db-install 2023-08-25T09:48:11.670 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:11.704 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-08-25T09:48:11.791 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-08-25T09:48:11.824 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-08-25T09:48:11.856 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-08-25T09:48:11.892 INFO:teuthology.orchestra.run.smithi149.stdout:Installing estimate-install 2023-08-25T09:48:11.965 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:11.996 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-08-25T09:48:12.068 INFO:teuthology.orchestra.run.smithi149.stdout:Installing fsck-install 2023-08-25T09:48:12.072 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-08-25T09:48:12.102 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-08-25T09:48:12.139 INFO:teuthology.orchestra.run.smithi149.stdout:Installing fsr-install 2023-08-25T09:48:12.214 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:12.245 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-08-25T09:48:12.317 INFO:teuthology.orchestra.run.smithi149.stdout:Installing growfs-install 2023-08-25T09:48:12.392 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:12.424 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-08-25T09:48:12.500 INFO:teuthology.orchestra.run.smithi149.stdout:Installing io-install 2023-08-25T09:48:14.525 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:14.560 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-08-25T09:48:14.637 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-08-25T09:48:14.708 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-08-25T09:48:14.778 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-08-25T09:48:14.854 INFO:teuthology.orchestra.run.smithi149.stdout:Installing logprint-install 2023-08-25T09:48:15.248 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:15.282 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-08-25T09:48:15.364 INFO:teuthology.orchestra.run.smithi149.stdout:Installing mkfs-install 2023-08-25T09:48:15.491 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-08-25T09:48:15.521 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-08-25T09:48:15.594 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-08-25T09:48:15.627 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-08-25T09:48:15.720 INFO:teuthology.orchestra.run.smithi149.stdout:Installing quota-install 2023-08-25T09:48:16.251 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:16.283 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-08-25T09:48:16.358 INFO:teuthology.orchestra.run.smithi149.stdout:Installing mdrestore-install 2023-08-25T09:48:16.430 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:16.463 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-08-25T09:48:16.544 INFO:teuthology.orchestra.run.smithi149.stdout:Installing repair-install 2023-08-25T09:48:18.449 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-08-25T09:48:18.481 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-08-25T09:48:18.569 INFO:teuthology.orchestra.run.smithi149.stdout:Installing rtcp-install 2023-08-25T09:48:18.643 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:18.676 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-08-25T09:48:18.746 INFO:teuthology.orchestra.run.smithi149.stdout:Installing m4-install 2023-08-25T09:48:18.750 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T09:48:18.753 INFO:teuthology.orchestra.run.smithi149.stdout:Installing man-install 2023-08-25T09:48:18.763 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[2]: Nothing to be done for 'install'. 2023-08-25T09:48:18.770 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[2]: Nothing to be done for 'install'. 2023-08-25T09:48:18.780 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-08-25T09:48:18.824 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-08-25T09:48:18.868 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-08-25T09:48:18.907 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-08-25T09:48:18.956 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-08-25T09:48:19.000 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-08-25T09:48:19.042 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-08-25T09:48:19.084 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-08-25T09:48:19.125 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-08-25T09:48:19.165 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-08-25T09:48:19.208 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-08-25T09:48:19.249 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-08-25T09:48:19.293 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-08-25T09:48:19.335 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-08-25T09:48:19.378 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-08-25T09:48:19.419 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-08-25T09:48:19.461 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-08-25T09:48:19.502 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-08-25T09:48:19.544 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-08-25T09:48:19.587 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-08-25T09:48:19.632 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-08-25T09:48:19.673 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-08-25T09:48:19.716 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-08-25T09:48:19.758 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-08-25T09:48:19.800 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-08-25T09:48:19.841 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-08-25T09:48:19.886 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-08-25T09:48:19.926 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-08-25T09:48:19.967 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-08-25T09:48:20.007 INFO:teuthology.orchestra.run.smithi149.stdout:Installing doc-install 2023-08-25T09:48:20.012 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-08-25T09:48:20.045 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-08-25T09:48:20.093 INFO:teuthology.orchestra.run.smithi149.stdout:Installing debian-install 2023-08-25T09:48:20.097 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T09:48:20.100 INFO:teuthology.orchestra.run.smithi149.stdout:Installing spaceman-install 2023-08-25T09:48:20.499 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:20.534 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-08-25T09:48:20.606 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-08-25T09:48:20.639 INFO:teuthology.orchestra.run.smithi149.stdout:Installing scrub-install 2023-08-25T09:48:21.680 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-08-25T09:48:21.711 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-08-25T09:48:21.782 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-08-25T09:48:21.816 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-08-25T09:48:21.849 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-08-25T09:48:21.916 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-08-25T09:48:21.951 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-08-25T09:48:21.992 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-08-25T09:48:22.028 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-08-25T09:48:22.063 INFO:teuthology.orchestra.run.smithi149.stdout:Installing po-install 2023-08-25T09:48:22.226 INFO:teuthology.orchestra.run.smithi149.stdout:Installing include-install 2023-08-25T09:48:22.230 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-08-25T09:48:22.264 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-08-25T09:48:22.297 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-08-25T09:48:22.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-25T09:48:22.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 Processor -- start 2023-08-25T09:48:22.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 -- start start 2023-08-25T09:48:22.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f4144c40 0x7f90f40bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90f414ddb0 0x7f90f414e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f4145020 con 0x7f90f40b6ec0 2023-08-25T09:48:22.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40b9330 con 0x7f90f414ddb0 2023-08-25T09:48:22.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.478+0000 7f90fa0d7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b7d70 con 0x7f90f4144c40 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90f414ddb0 0x7f90f414e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90f414ddb0 0x7f90f414e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49218/0 (socket says 172.21.15.89:49218) 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 -- 172.21.15.89:0/3353239523 learned_addr learned my addr 172.21.15.89:0/3353239523 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f37fe640 1 --2- 172.21.15.89:0/3353239523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f4144c40 0x7f90f40bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 -- 172.21.15.89:0/3353239523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f4144c40 msgr2=0x7f90f40bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 --2- 172.21.15.89:0/3353239523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f4144c40 0x7f90f40bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 -- 172.21.15.89:0/3353239523 >> v1:172.21.15.89:6789/0 conn(0x7f90f40b6ec0 legacy=0x7f90f40b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f2ffd640 1 -- 172.21.15.89:0/3353239523 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966533365 0 0) 0x7f90f4145020 con 0x7f90f40b6ec0 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.479+0000 7f90f3fff640 1 -- 172.21.15.89:0/3353239523 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40bd290 con 0x7f90f414ddb0 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90f3fff640 1 --2- 172.21.15.89:0/3353239523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f414ddb0 0x7f90f414e240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009e50 tx=0x7f90ec02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c72c7ddb5762812 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90f2ffd640 1 -- 172.21.15.89:0/3353239523 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec02cb00 con 0x7f90f414ddb0 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90f2ffd640 1 -- 172.21.15.89:0/3353239523 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec02cc60 con 0x7f90f414ddb0 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90f2ffd640 1 -- 172.21.15.89:0/3353239523 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0343f0 con 0x7f90f414ddb0 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90fa0d7640 1 -- 172.21.15.89:0/3353239523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f414ddb0 msgr2=0x7f90f414e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/3353239523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f414ddb0 0x7f90f414e240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009e50 tx=0x7f90ec02bf60 comp rx=0 tx=0).stop 2023-08-25T09:48:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90fa0d7640 1 -- 172.21.15.89:0/3353239523 shutdown_connections 2023-08-25T09:48:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/3353239523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f414ddb0 0x7f90f414e240 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/3353239523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f4144c40 0x7f90f40bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.480+0000 7f90fa0d7640 1 -- 172.21.15.89:0/3353239523 >> 172.21.15.89:0/3353239523 conn(0x7f90f40654f0 msgr2=0x7f90f40658d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:48:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.481+0000 7f90fa0d7640 1 -- 172.21.15.89:0/3353239523 shutdown_connections 2023-08-25T09:48:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.481+0000 7f90fa0d7640 1 -- 172.21.15.89:0/3353239523 wait complete. 2023-08-25T09:48:22.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 Processor -- start 2023-08-25T09:48:22.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 -- start start 2023-08-25T09:48:22.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90f40b6ec0 0x7f90f414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 0x7f90f40b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f414ddb0 0x7f90f40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f414d9f0 con 0x7f90f4144c40 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b2aa0 con 0x7f90f40b6ec0 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90fa0d7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b2240 con 0x7f90f414ddb0 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 0x7f90f40b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 0x7f90f40b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49232/0 (socket says 172.21.15.89:49232) 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90ebfff640 1 -- 172.21.15.89:0/180065166 learned_addr learned my addr 172.21.15.89:0/180065166 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90f3fff640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f414ddb0 0x7f90f40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.482+0000 7f90f37fe640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90f40b6ec0 0x7f90f414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90ebfff640 1 -- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f414ddb0 msgr2=0x7f90f40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90ebfff640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f414ddb0 0x7f90f40b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90ebfff640 1 -- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90f40b6ec0 msgr2=0x7f90f414d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90ebfff640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90f40b6ec0 0x7f90f414d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90ebfff640 1 -- 172.21.15.89:0/180065166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009b30 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90ebfff640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 0x7f90f40b1190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c520 tx=0x7f90dc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0035f0 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc003770 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f40b3580 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc003b20 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.483+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40b27c0 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.484+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f40bba70 con 0x7f90f4144c40 2023-08-25T09:48:22.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.484+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90dc003c80 con 0x7f90f4144c40 2023-08-25T09:48:22.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.485+0000 7f90f0ff9640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f90d406a080 0x7f90d406c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.485+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f90dc087b90 con 0x7f90f4144c40 2023-08-25T09:48:22.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.485+0000 7f90f37fe640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f90d406a080 0x7f90d406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.485+0000 7f90f37fe640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f90d406a080 0x7f90d406c540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90e400aac0 tx=0x7f90e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:48:22.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.489+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f90dc053300 con 0x7f90f4144c40 2023-08-25T09:48:22.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.723+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f90f40afe40 con 0x7f90f4144c40 2023-08-25T09:48:22.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.724+0000 7f90f0ff9640 1 -- 172.21.15.89:0/180065166 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f90dc017510 con 0x7f90f4144c40 2023-08-25T09:48:22.726 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T09:48:22.726 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","modified":"2023-08-25T09:41:01.929999Z","created":"2023-08-25T09:41:01.929999Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3301","nonce":0},{"type":"v1","addr":"172.21.15.121:6790","nonce":0}]},"addr":"172.21.15.121:6790/0","public_addr":"172.21.15.121:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-25T09:48:22.726 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2023-08-25T09:48:22.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f90d406a080 msgr2=0x7f90d406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f90d406a080 0x7f90d406c540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90e400aac0 tx=0x7f90e4008040 comp rx=0 tx=0).stop 2023-08-25T09:48:22.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 msgr2=0x7f90f40b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 0x7f90f40b1190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c520 tx=0x7f90dc00c9e0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 shutdown_connections 2023-08-25T09:48:22.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f90d406a080 0x7f90d406c540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90f4144c40 0x7f90f40b1190 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90f414ddb0 0x7f90f40b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 --2- 172.21.15.89:0/180065166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90f40b6ec0 0x7f90f414d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 >> 172.21.15.89:0/180065166 conn(0x7f90f40654f0 msgr2=0x7f90f4143570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:48:22.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.725+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 shutdown_connections 2023-08-25T09:48:22.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.726+0000 7f90fa0d7640 1 -- 172.21.15.89:0/180065166 wait complete. 2023-08-25T09:48:22.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-08-25T09:48:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.835+0000 7f64ee9e1640 1 Processor -- start 2023-08-25T09:48:22.837 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.835+0000 7f64ee9e1640 1 -- start start 2023-08-25T09:48:22.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64ee9e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f64e80b7c10 0x7f64e806ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.840 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64ee9e1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80ba920 con 0x7f64e80bad20 2023-08-25T09:48:22.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64ee9e1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e814e230 con 0x7f64e814b050 2023-08-25T09:48:22.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64ee9e1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e806c1a0 con 0x7f64e80b7c10 2023-08-25T09:48:22.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64e7fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f64e80bad20 0x7f64e814a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46430/0 (socket says 172.21.15.89:46430) 2023-08-25T09:48:22.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64e7fff640 1 -- 172.21.15.89:0/4260905427 learned_addr learned my addr 172.21.15.89:0/4260905427 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T09:48:22.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570148743 0 0) 0x7f64e80ba920 con 0x7f64e80bad20 2023-08-25T09:48:22.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d0003520 con 0x7f64e80bad20 2023-08-25T09:48:22.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.836+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/4260905427 >> v2:172.21.15.121:3300/0 conn(0x7f64e80b7c10 0x7f64e806ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981017650 0 0) 0x7f64d0003520 con 0x7f64e80bad20 2023-08-25T09:48:22.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 >> v2:172.21.15.121:3300/0 conn(0x7f64e80b7c10 msgr2=0x7f64e806ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:48:22.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 --2- 172.21.15.89:0/4260905427 >> v2:172.21.15.121:3300/0 conn(0x7f64e80b7c10 0x7f64e806ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 >> v1:172.21.15.121:6789/0 conn(0x7f64e814b050 legacy=0x7f64e80b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e814e510 con 0x7f64e80bad20 2023-08-25T09:48:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 505315410 0 0) 0x7f64d8001670 con 0x7f64e80bad20 2023-08-25T09:48:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 >> v1:172.21.15.89:6789/0 conn(0x7f64e80bad20 legacy=0x7f64e814a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d00039e0 0x7f64d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64d00047c0 0x7f64d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64d0005180 0x7f64d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e806c1a0 con 0x7f64d0005180 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d000c0b0 con 0x7f64d00047c0 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d000c270 con 0x7f64d00039e0 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64d0005180 0x7f64d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e7fff640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d00039e0 0x7f64d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e77fe640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64d00047c0 0x7f64d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64ecf7e640 1 -- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d00039e0 msgr2=0x7f64d0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d00039e0 0x7f64d0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64ecf7e640 1 -- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64d00047c0 msgr2=0x7f64d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64d00047c0 0x7f64d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64ecf7e640 1 -- 172.21.15.89:0/4260905427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0003520 con 0x7f64d0005180 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.837+0000 7f64e77fe640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64d00047c0 0x7f64d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.838+0000 7f64ecf7e640 1 -- 172.21.15.89:0/4260905427 reap_dead start 2023-08-25T09:48:22.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.838+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64d0005180 0x7f64d000b980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009fc0 tx=0x7f64d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd92fdbb8488da3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.838+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e002cc60 con 0x7f64d0005180 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.838+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e000f040 con 0x7f64d0005180 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.838+0000 7f64e6ffd640 1 -- 172.21.15.89:0/4260905427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0003990 con 0x7f64d0005180 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 -- 172.21.15.89:0/4260905427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64d0005180 msgr2=0x7f64d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64d0005180 0x7f64d000b980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009fc0 tx=0x7f64d00057f0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 -- 172.21.15.89:0/4260905427 shutdown_connections 2023-08-25T09:48:22.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/4260905427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64d0005180 0x7f64d000b980 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 -- 172.21.15.89:0/4260905427 >> 172.21.15.89:0/4260905427 conn(0x7f64e80654f0 msgr2=0x7f64e8065900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:48:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 -- 172.21.15.89:0/4260905427 shutdown_connections 2023-08-25T09:48:22.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.839+0000 7f64ee9e1640 1 -- 172.21.15.89:0/4260905427 wait complete. 2023-08-25T09:48:22.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 Processor -- start 2023-08-25T09:48:22.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 -- start start 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d0005180 0x7f64e813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 0x7f64e81e0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e813c9f0 0x7f64e81e0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e813d080 con 0x7f64e813c570 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e813dd50 con 0x7f64e813c9f0 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64ee9e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e813bd00 con 0x7f64d0005180 2023-08-25T09:48:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64e77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 0x7f64e81e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64e77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 0x7f64e81e0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49250/0 (socket says 172.21.15.89:49250) 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.840+0000 7f64e77fe640 1 -- 172.21.15.89:0/185199678 learned_addr learned my addr 172.21.15.89:0/185199678 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e813c9f0 0x7f64e81e0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e7fff640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d0005180 0x7f64e813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e77fe640 1 -- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d0005180 msgr2=0x7f64e813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e77fe640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d0005180 0x7f64e813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e77fe640 1 -- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e813c9f0 msgr2=0x7f64e81e0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e77fe640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e813c9f0 0x7f64e81e0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e77fe640 1 -- 172.21.15.89:0/185199678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80b6a50 con 0x7f64e813c570 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e7fff640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d0005180 0x7f64e813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64ecf7e640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e813c9f0 0x7f64e81e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e77fe640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 0x7f64e81e0010 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f64dc000c00 tx=0x7f64dc00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0052e0 con 0x7f64e813c570 2023-08-25T09:48:22.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc005440 con 0x7f64e813c570 2023-08-25T09:48:22.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80b6d30 con 0x7f64e813c570 2023-08-25T09:48:22.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc003830 con 0x7f64e813c570 2023-08-25T09:48:22.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.841+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e813c050 con 0x7f64e813c570 2023-08-25T09:48:22.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.842+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e814e7d0 con 0x7f64e813c570 2023-08-25T09:48:22.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.843+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64dc003990 con 0x7f64e813c570 2023-08-25T09:48:22.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.843+0000 7f64e4ff9640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f64d406a050 0x7f64d406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T09:48:22.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.843+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f64dc087d00 con 0x7f64e813c570 2023-08-25T09:48:22.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.843+0000 7f64e7fff640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f64d406a050 0x7f64d406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T09:48:22.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.843+0000 7f64e7fff640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f64d406a050 0x7f64d406c510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f64d8007c60 tx=0x7f64d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T09:48:22.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:22.847+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f64e814e7d0 con 0x7f64e813c570 2023-08-25T09:48:23.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.077+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f64e814e7d0 con 0x7f64e813c570 2023-08-25T09:48:23.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.077+0000 7f64e4ff9640 1 -- 172.21.15.89:0/185199678 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f64e814e7d0 con 0x7f64e813c570 2023-08-25T09:48:23.079 INFO:teuthology.orchestra.run.smithi089.stdout:[client.admin] 2023-08-25T09:48:23.079 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAud+hkcLwgExAACDhMTse7FXgXw35v69zYKw== 2023-08-25T09:48:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f64d406a050 msgr2=0x7f64d406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f64d406a050 0x7f64d406c510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f64d8007c60 tx=0x7f64d8009040 comp rx=0 tx=0).stop 2023-08-25T09:48:23.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 msgr2=0x7f64e81e0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 0x7f64e81e0010 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f64dc000c00 tx=0x7f64dc00e8f0 comp rx=0 tx=0).stop 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 shutdown_connections 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f64d406a050 0x7f64d406c510 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e813c570 0x7f64e81e0010 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e813c9f0 0x7f64e81e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 --2- 172.21.15.89:0/185199678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64d0005180 0x7f64e813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T09:48:23.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 >> 172.21.15.89:0/185199678 conn(0x7f64e80654f0 msgr2=0x7f64e80b8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T09:48:23.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 shutdown_connections 2023-08-25T09:48:23.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T09:48:23.080+0000 7f64ee9e1640 1 -- 172.21.15.89:0/185199678 wait complete. 2023-08-25T09:48:23.091 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T09:48:23.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/tmp/tmp.pUGqPxeVwnxfstests-dev/local.config 2023-08-25T09:48:23.199 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.89:6789:/test export TEST_DIR=/tmp/tmp.Wj7ZcASf2Mtest export SCRATCH_DEV=172.21.15.89:6789:/scratch export SCRATCH_MNT=/tmp/tmp.CbXXksMJn5scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAud+hkcLwgExAACDhMTse7FXgXw35v69zYKw==,test_dummy_encryption" 2023-08-25T09:48:23.199 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-08-25T09:48:23.200 DEBUG:teuthology.orchestra.run.smithi149:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.pUGqPxeVwnxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-08-25T09:48:25.921 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-08-25T09:48:25.935 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:20:17 UTC 2023 2023-08-25T09:48:25.937 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.89:6789:/scratch 2023-08-25T09:48:25.940 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAud+hkcLwgExAACDhMTse7FXgXw35v69zYKw==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.89:6789:/scratch /tmp/tmp.CbXXksMJn5scratch 2023-08-25T09:48:25.940 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-08-25T09:48:26.697 INFO:teuthology.orchestra.run.smithi149.stdout:ceph/001 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-08-25T09:48:27.238 INFO:teuthology.orchestra.run.smithi149.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-08-25T09:48:27.713 INFO:teuthology.orchestra.run.smithi149.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-08-25T09:48:28.331 INFO:teuthology.orchestra.run.smithi149.stdout:ceph/004 1s 2023-08-25T09:48:28.756 INFO:teuthology.orchestra.run.smithi149.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-08-25T09:48:32.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:32.115 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:32.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:39.063 INFO:teuthology.orchestra.run.smithi149.stdout:generic/001 11s 2023-08-25T09:48:39.973 INFO:teuthology.orchestra.run.smithi149.stdout:generic/002 0s 2023-08-25T09:48:40.405 INFO:teuthology.orchestra.run.smithi149.stdout:generic/003 [not run] atime not maintained by ceph 2023-08-25T09:48:40.879 INFO:teuthology.orchestra.run.smithi149.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-08-25T09:48:41.718 INFO:teuthology.orchestra.run.smithi149.stdout:generic/005 1s 2023-08-25T09:49:02.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:02.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:02.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:05.254 INFO:teuthology.orchestra.run.smithi149.stdout:generic/006 24s 2023-08-25T09:49:32.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:32.366 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:32.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:50.354 INFO:teuthology.orchestra.run.smithi149.stdout:generic/007 45s 2023-08-25T09:49:52.592 INFO:teuthology.orchestra.run.smithi149.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-25T09:49:54.823 INFO:teuthology.orchestra.run.smithi149.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-25T09:50:02.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:02.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:02.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:26.702 INFO:teuthology.orchestra.run.smithi149.stdout:generic/011 32s 2023-08-25T09:50:28.923 INFO:teuthology.orchestra.run.smithi149.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T09:50:32.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:32.865 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:32.868 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:03.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:03.194 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:03.197 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:33.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:33.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:33.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:33.684 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-08-25T09:51:33.683+0000 7f1f011e0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104104) UID: 0 2023-08-25T09:51:33.685 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T09:51:33.683+0000 7f393519f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104104) UID: 0 2023-08-25T09:54:40.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:40.204 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:40.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:41.831 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-08-25T09:54:41.830+0000 7f1f011e0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104127) UID: 0 2023-08-25T09:54:41.832 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T09:54:41.830+0000 7f393519f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104127) UID: 0 2023-08-25T09:56:00.834 INFO:teuthology.orchestra.run.smithi149.stdout:generic/013 332s 2023-08-25T09:58:34.246 INFO:teuthology.orchestra.run.smithi149.stdout:generic/014 154s 2023-08-25T09:58:34.677 INFO:teuthology.orchestra.run.smithi149.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-08-25T09:58:39.641 INFO:teuthology.orchestra.run.smithi149.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T09:58:40.257 INFO:teuthology.orchestra.run.smithi149.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-08-25T09:58:48.491 INFO:teuthology.orchestra.run.smithi149.stdout:generic/020 8s 2023-08-25T09:58:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T09:58:56.421 INFO:teuthology.orchestra.run.smithi149.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T09:59:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:generic/023 45s 2023-08-25T09:59:42.080 INFO:teuthology.orchestra.run.smithi149.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-08-25T09:59:42.531 INFO:teuthology.orchestra.run.smithi149.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-08-25T09:59:43.035 INFO:teuthology.orchestra.run.smithi149.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-08-25T09:59:48.543 INFO:teuthology.orchestra.run.smithi149.stdout:generic/028 5s 2023-08-25T09:59:49.792 INFO:teuthology.orchestra.run.smithi149.stdout:generic/029 1s 2023-08-25T09:59:54.906 INFO:teuthology.orchestra.run.smithi149.stdout:generic/030 5s 2023-08-25T09:59:59.420 INFO:teuthology.orchestra.run.smithi149.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-25T09:59:59.891 INFO:teuthology.orchestra.run.smithi149.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-25T10:00:05.032 INFO:teuthology.orchestra.run.smithi149.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-25T10:00:05.511 INFO:teuthology.orchestra.run.smithi149.stdout:generic/034 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:06.065 INFO:teuthology.orchestra.run.smithi149.stdout:generic/035 1s 2023-08-25T10:00:13.386 INFO:teuthology.orchestra.run.smithi149.stdout:generic/037 7s 2023-08-25T10:00:13.933 INFO:teuthology.orchestra.run.smithi149.stdout:generic/039 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:14.434 INFO:teuthology.orchestra.run.smithi149.stdout:generic/040 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:14.936 INFO:teuthology.orchestra.run.smithi149.stdout:generic/041 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:15.595 INFO:teuthology.orchestra.run.smithi149.stdout:generic/042 [not run] ceph does not support shutdown 2023-08-25T10:00:16.257 INFO:teuthology.orchestra.run.smithi149.stdout:generic/050 [not run] ceph does not support shutdown 2023-08-25T10:00:16.927 INFO:teuthology.orchestra.run.smithi149.stdout:generic/052 [not run] ceph does not support shutdown 2023-08-25T10:00:18.145 INFO:teuthology.orchestra.run.smithi149.stdout:generic/053 2s 2023-08-25T10:00:18.727 INFO:teuthology.orchestra.run.smithi149.stdout:generic/056 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:19.243 INFO:teuthology.orchestra.run.smithi149.stdout:generic/057 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:22.914 INFO:teuthology.orchestra.run.smithi149.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T10:00:23.433 INFO:teuthology.orchestra.run.smithi149.stdout:generic/059 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:27.994 INFO:teuthology.orchestra.run.smithi149.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T10:00:35.904 INFO:teuthology.orchestra.run.smithi149.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T10:00:38.408 INFO:teuthology.orchestra.run.smithi149.stdout:generic/062 3s 2023-08-25T10:00:44.843 INFO:teuthology.orchestra.run.smithi149.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-08-25T10:00:45.344 INFO:teuthology.orchestra.run.smithi149.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T10:00:45.856 INFO:teuthology.orchestra.run.smithi149.stdout:generic/065 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:46.326 INFO:teuthology.orchestra.run.smithi149.stdout:generic/066 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:00:46.843 INFO:teuthology.orchestra.run.smithi149.stdout:generic/067 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:01:11.642 INFO:teuthology.orchestra.run.smithi149.stdout:generic/069 25s 2023-08-25T10:01:24.183 INFO:teuthology.orchestra.run.smithi149.stdout:generic/070 13s 2023-08-25T10:01:24.631 INFO:teuthology.orchestra.run.smithi149.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-08-25T10:01:25.106 INFO:teuthology.orchestra.run.smithi149.stdout:generic/073 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:01:56.386 INFO:teuthology.orchestra.run.smithi149.stdout:generic/075 31s 2023-08-25T10:01:56.872 INFO:teuthology.orchestra.run.smithi149.stdout:generic/076 [not run] require 172.21.15.89:6789:/scratch to be local device 2023-08-25T10:01:57.331 INFO:teuthology.orchestra.run.smithi149.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-08-25T10:01:57.778 INFO:teuthology.orchestra.run.smithi149.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-08-25T10:02:00.322 INFO:teuthology.orchestra.run.smithi149.stdout:generic/080 3s 2023-08-25T10:02:00.843 INFO:teuthology.orchestra.run.smithi149.stdout:generic/081 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:02:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-08-25T10:02:03.958 INFO:tasks.ceph.mds.a.smithi089.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f1ef99d1640 time 2023-08-25T10:02:03.868803+0000 2023-08-25T10:02:03.959 INFO:tasks.ceph.mds.a.smithi089.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-25T10:02:04.009 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.009 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f055630fb] 2023-08-25T10:02:04.009 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.010 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.010 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.010 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.010 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.011 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.011 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.011 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.011 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.012 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.012 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.012 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.012 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.012 INFO:tasks.ceph.mds.a.smithi089.stderr:*** Caught signal (Aborted) ** 2023-08-25T10:02:04.012 INFO:tasks.ceph.mds.a.smithi089.stderr: in thread 7f1ef99d1640 thread_name:MR_Finisher 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-08-25T10:02:04.007+0000 7f1ef99d1640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f1ef99d1640 time 2023-08-25T10:02:03.868803+0000 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f055630fb] 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.013 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.014 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.015 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.015 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.015 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.016 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.016 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.016 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: /lib64/libc.so.6(+0x54df0) [0x7f1f04c54df0] 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1f04ca154c] 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: raise() 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: abort() 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f05563155] 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.017 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.018 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.018 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.018 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.018 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.019 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.020 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.020 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.020 INFO:tasks.ceph.mds.a.smithi089.stderr: 15: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.021 INFO:tasks.ceph.mds.a.smithi089.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.021 INFO:tasks.ceph.mds.a.smithi089.stderr: 17: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.021 INFO:tasks.ceph.mds.a.smithi089.stderr: 18: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.021 INFO:tasks.ceph.mds.a.smithi089.stderr:2023-08-25T10:02:04.008+0000 7f1ef99d1640 -1 *** Caught signal (Aborted) ** 2023-08-25T10:02:04.022 INFO:tasks.ceph.mds.a.smithi089.stderr: in thread 7f1ef99d1640 thread_name:MR_Finisher 2023-08-25T10:02:04.023 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.023 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.023 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: /lib64/libc.so.6(+0x54df0) [0x7f1f04c54df0] 2023-08-25T10:02:04.023 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1f04ca154c] 2023-08-25T10:02:04.024 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: raise() 2023-08-25T10:02:04.024 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: abort() 2023-08-25T10:02:04.025 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f05563155] 2023-08-25T10:02:04.025 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.025 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.025 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.026 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.026 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.026 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.026 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.026 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.027 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.027 INFO:tasks.ceph.mds.a.smithi089.stderr: 15: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.027 INFO:tasks.ceph.mds.a.smithi089.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.028 INFO:tasks.ceph.mds.a.smithi089.stderr: 17: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.028 INFO:tasks.ceph.mds.a.smithi089.stderr: 18: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.028 INFO:tasks.ceph.mds.a.smithi089.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-08-25T10:02:04.028 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.029 INFO:tasks.ceph.mds.a.smithi089.stderr: -1> 2023-08-25T10:02:04.007+0000 7f1ef99d1640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f1ef99d1640 time 2023-08-25T10:02:03.868803+0000 2023-08-25T10:02:04.029 INFO:tasks.ceph.mds.a.smithi089.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-25T10:02:04.029 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.030 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.030 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f055630fb] 2023-08-25T10:02:04.030 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.030 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.031 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.031 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.031 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.031 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.031 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.032 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.032 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.033 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.033 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.033 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.033 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.034 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.034 INFO:tasks.ceph.mds.a.smithi089.stderr: 0> 2023-08-25T10:02:04.008+0000 7f1ef99d1640 -1 *** Caught signal (Aborted) ** 2023-08-25T10:02:04.034 INFO:tasks.ceph.mds.a.smithi089.stderr: in thread 7f1ef99d1640 thread_name:MR_Finisher 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: /lib64/libc.so.6(+0x54df0) [0x7f1f04c54df0] 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1f04ca154c] 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: raise() 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: abort() 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f05563155] 2023-08-25T10:02:04.035 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.036 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.037 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.037 INFO:tasks.ceph.mds.a.smithi089.stderr: 15: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.037 INFO:tasks.ceph.mds.a.smithi089.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.037 INFO:tasks.ceph.mds.a.smithi089.stderr: 17: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.037 INFO:tasks.ceph.mds.a.smithi089.stderr: 18: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.037 INFO:tasks.ceph.mds.a.smithi089.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-08-25T10:02:04.038 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.038 INFO:tasks.ceph.mds.a.smithi089.stderr: -1> 2023-08-25T10:02:04.007+0000 7f1ef99d1640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: In function 'virtual void CInode::auth_unpin(void*)' thread 7f1ef99d1640 time 2023-08-25T10:02:03.868803+0000 2023-08-25T10:02:04.039 INFO:tasks.ceph.mds.a.smithi089.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-5703-gba6b39e4/rpm/el9/BUILD/ceph-18.0.0-5703-gba6b39e4/src/mds/CInode.cc: 2980: FAILED ceph_assert(auth_pins >= 0) 2023-08-25T10:02:04.039 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.039 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.039 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f055630fb] 2023-08-25T10:02:04.039 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.039 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.040 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.040 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.041 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.041 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.041 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.041 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.041 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.042 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.042 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.042 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.042 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.042 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.043 INFO:tasks.ceph.mds.a.smithi089.stderr: 0> 2023-08-25T10:02:04.008+0000 7f1ef99d1640 -1 *** Caught signal (Aborted) ** 2023-08-25T10:02:04.043 INFO:tasks.ceph.mds.a.smithi089.stderr: in thread 7f1ef99d1640 thread_name:MR_Finisher 2023-08-25T10:02:04.043 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:04.043 INFO:tasks.ceph.mds.a.smithi089.stderr: ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev) 2023-08-25T10:02:04.044 INFO:tasks.ceph.mds.a.smithi089.stderr: 1: /lib64/libc.so.6(+0x54df0) [0x7f1f04c54df0] 2023-08-25T10:02:04.044 INFO:tasks.ceph.mds.a.smithi089.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1f04ca154c] 2023-08-25T10:02:04.044 INFO:tasks.ceph.mds.a.smithi089.stderr: 3: raise() 2023-08-25T10:02:04.044 INFO:tasks.ceph.mds.a.smithi089.stderr: 4: abort() 2023-08-25T10:02:04.045 INFO:tasks.ceph.mds.a.smithi089.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f05563155] 2023-08-25T10:02:04.045 INFO:tasks.ceph.mds.a.smithi089.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x1632b9) [0x7f1f055632b9] 2023-08-25T10:02:04.045 INFO:tasks.ceph.mds.a.smithi089.stderr: 7: (CInode::auth_unpin(void*)+0x266) [0x55f10a878566] 2023-08-25T10:02:04.046 INFO:tasks.ceph.mds.a.smithi089.stderr: 8: (MutationImpl::drop_local_auth_pins()+0x39) [0x55f10a716549] 2023-08-25T10:02:04.046 INFO:tasks.ceph.mds.a.smithi089.stderr: 9: (MDCache::request_cleanup(boost::intrusive_ptr&)+0xe6) [0x55f10a78bc66] 2023-08-25T10:02:04.046 INFO:tasks.ceph.mds.a.smithi089.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x58f) [0x55f10a6b080f] 2023-08-25T10:02:04.046 INFO:tasks.ceph.mds.a.smithi089.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x11e) [0x55f10a6b0f9e] 2023-08-25T10:02:04.046 INFO:tasks.ceph.mds.a.smithi089.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x319) [0x55f10a6da199] 2023-08-25T10:02:04.046 INFO:tasks.ceph.mds.a.smithi089.stderr: 13: (MDSContext::complete(int)+0x5c) [0x55f10a8c980c] 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x55f10a8c9c5c] 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: 15: (MDSLogContextBase::complete(int)+0x53) [0x55f10a8c9db3] 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: 16: (Finisher::finisher_thread_entry()+0x175) [0x7f1f05617aa5] 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: 17: /lib64/libc.so.6(+0x9f802) [0x7f1f04c9f802] 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: 18: /lib64/libc.so.6(+0x3f450) [0x7f1f04c3f450] 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-08-25T10:02:04.047 INFO:tasks.ceph.mds.a.smithi089.stderr: 2023-08-25T10:02:07.951 INFO:tasks.ceph.mds.a.smithi089.stderr:daemon-helper: command crashed with signal 6 2023-08-25T10:02:10.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-08-25T10:02:16.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-08-25T10:02:23.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-08-25T10:02:26.798 INFO:teuthology.orchestra.run.smithi149.stdout:generic/084 25s 2023-08-25T10:02:26.928 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T10:02:26.927+0000 7f3931197640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T10:02:27.321 INFO:teuthology.orchestra.run.smithi149.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-25T10:02:27.922 INFO:teuthology.orchestra.run.smithi149.stdout:generic/087 0s 2023-08-25T10:02:28.424 INFO:teuthology.orchestra.run.smithi149.stdout:generic/088 1s 2023-08-25T10:02:28.898 INFO:teuthology.orchestra.run.smithi149.stdout:generic/090 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:02:29.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-08-25T10:02:36.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2023-08-25T10:02:42.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2023-08-25T10:02:49.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~39s 2023-08-25T10:02:55.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2023-08-25T10:03:02.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~52s 2023-08-25T10:03:08.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~59s 2023-08-25T10:03:15.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-08-25T10:03:21.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~72s 2023-08-25T10:03:28.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~78s 2023-08-25T10:03:33.728 INFO:teuthology.orchestra.run.smithi149.stdout:generic/091 65s 2023-08-25T10:03:34.227 INFO:teuthology.orchestra.run.smithi149.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-25T10:03:34.752 INFO:teuthology.orchestra.run.smithi149.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T10:03:34.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2023-08-25T10:03:38.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:38.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:38.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:38.361 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T10:03:38.359+0000 7f393519f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104634) UID: 0 2023-08-25T10:03:41.384 INFO:teuthology.orchestra.run.smithi149.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-25T10:03:41.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~91s 2023-08-25T10:03:42.215 INFO:teuthology.orchestra.run.smithi149.stdout:generic/097 1s 2023-08-25T10:03:43.447 INFO:teuthology.orchestra.run.smithi149.stdout:generic/098 1s 2023-08-25T10:03:45.008 INFO:teuthology.orchestra.run.smithi149.stdout:generic/099 1s 2023-08-25T10:03:45.480 INFO:teuthology.orchestra.run.smithi149.stdout:generic/101 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:03:45.986 INFO:teuthology.orchestra.run.smithi149.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-08-25T10:03:46.476 INFO:teuthology.orchestra.run.smithi149.stdout:generic/104 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:03:47.511 INFO:teuthology.orchestra.run.smithi149.stdout:generic/105 1s 2023-08-25T10:03:47.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~98s 2023-08-25T10:03:48.106 INFO:teuthology.orchestra.run.smithi149.stdout:generic/106 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:03:48.630 INFO:teuthology.orchestra.run.smithi149.stdout:generic/107 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:03:49.245 INFO:teuthology.orchestra.run.smithi149.stdout:generic/108 [not run] require 172.21.15.89:6789:/scratch to be valid block disk 2023-08-25T10:03:49.780 INFO:teuthology.orchestra.run.smithi149.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-08-25T10:03:50.294 INFO:teuthology.orchestra.run.smithi149.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-08-25T10:03:54.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~104s 2023-08-25T10:04:00.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~111s 2023-08-25T10:04:07.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~117s 2023-08-25T10:04:13.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~124s 2023-08-25T10:04:14.854 INFO:teuthology.orchestra.run.smithi149.stdout:generic/112 24s 2023-08-25T10:04:20.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2023-08-25T10:04:26.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~137s 2023-08-25T10:04:33.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~143s 2023-08-25T10:04:40.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2023-08-25T10:04:46.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~156s 2023-08-25T10:04:53.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~163s 2023-08-25T10:04:59.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~169s 2023-08-25T10:05:06.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~176s 2023-08-25T10:05:12.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~182s 2023-08-25T10:05:19.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~189s 2023-08-25T10:05:25.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2023-08-25T10:05:32.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~202s 2023-08-25T10:05:38.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~208s 2023-08-25T10:05:45.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2023-08-25T10:05:51.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~221s 2023-08-25T10:05:58.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~228s 2023-08-25T10:06:04.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~234s 2023-08-25T10:06:11.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~241s 2023-08-25T10:06:14.248 INFO:teuthology.orchestra.run.smithi149.stdout:generic/113 120s 2023-08-25T10:06:14.746 INFO:teuthology.orchestra.run.smithi149.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-08-25T10:06:15.259 INFO:teuthology.orchestra.run.smithi149.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-08-25T10:06:15.779 INFO:teuthology.orchestra.run.smithi149.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-08-25T10:06:17.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~247s 2023-08-25T10:06:22.867 INFO:teuthology.orchestra.run.smithi149.stdout:generic/117 7s 2023-08-25T10:06:23.448 INFO:teuthology.orchestra.run.smithi149.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-08-25T10:06:23.991 INFO:teuthology.orchestra.run.smithi149.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-08-25T10:06:24.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~254s 2023-08-25T10:06:24.469 INFO:teuthology.orchestra.run.smithi149.stdout:generic/120 [not run] atime not maintained by ceph 2023-08-25T10:06:24.994 INFO:teuthology.orchestra.run.smithi149.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-25T10:06:25.509 INFO:teuthology.orchestra.run.smithi149.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-08-25T10:06:26.587 INFO:teuthology.orchestra.run.smithi149.stdout:generic/123 1s 2023-08-25T10:06:30.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~261s 2023-08-25T10:06:37.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~267s 2023-08-25T10:06:43.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~274s 2023-08-25T10:06:50.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2023-08-25T10:06:56.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~287s 2023-08-25T10:06:58.802 INFO:teuthology.orchestra.run.smithi149.stdout:generic/124 32s 2023-08-25T10:06:59.608 INFO:teuthology.orchestra.run.smithi149.stdout:generic/126 1s 2023-08-25T10:07:03.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~293s 2023-08-25T10:07:09.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~300s 2023-08-25T10:07:11.209 INFO:teuthology.orchestra.run.smithi149.stdout:generic/128 12s 2023-08-25T10:07:16.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~306s 2023-08-25T10:07:16.325 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-08-25T10:07:16.326 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T10:07:16.326 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T10:07:16.391 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-08-25T10:07:16.391 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T10:07:16.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T10:07:16.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.865+0000 7f5554a0d640 1 Processor -- start 2023-08-25T10:07:16.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.865+0000 7f5554a0d640 1 -- start start 2023-08-25T10:07:16.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5554a0d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5554a0d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55501494a0 0x7f555006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5554a0d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55500b4a90 0x7f55500b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5554a0d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55500b52e0 con 0x7f55500b4a90 2023-08-25T10:07:16.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5554a0d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555006e550 con 0x7f55501494a0 2023-08-25T10:07:16.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5554a0d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5550149010 con 0x7f555006eba0 2023-08-25T10:07:16.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f554e59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f554ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55500b4a90 0x7f55500b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f5545d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55501494a0 0x7f555006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f554e59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43844/0 (socket says 172.21.15.89:43844) 2023-08-25T10:07:16.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.866+0000 7f554e59c640 1 -- 172.21.15.89:0/3163404710 learned_addr learned my addr 172.21.15.89:0/3163404710 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:16.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554ed9d640 1 -- 172.21.15.89:0/3163404710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 msgr2=0x7f555006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:16.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554ed9d640 1 --2- 172.21.15.89:0/3163404710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554ed9d640 1 -- 172.21.15.89:0/3163404710 >> v2:172.21.15.121:3300/0 conn(0x7f55501494a0 msgr2=0x7f555006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:16.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554ed9d640 1 --2- 172.21.15.89:0/3163404710 >> v2:172.21.15.121:3300/0 conn(0x7f55501494a0 0x7f555006d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554ed9d640 1 -- 172.21.15.89:0/3163404710 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55501489c0 con 0x7f55500b4a90 2023-08-25T10:07:16.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554ed9d640 1 --2- 172.21.15.89:0/3163404710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55500b4a90 0x7f55500b9a60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f55500664a0 tx=0x7f554802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e66387f987635d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:16.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.867+0000 7f554dd9b640 1 -- 172.21.15.89:0/3163404710 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554802f050 con 0x7f55500b4a90 2023-08-25T10:07:16.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f554dd9b640 1 -- 172.21.15.89:0/3163404710 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548031700 con 0x7f55500b4a90 2023-08-25T10:07:16.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f554dd9b640 1 -- 172.21.15.89:0/3163404710 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548031a90 con 0x7f55500b4a90 2023-08-25T10:07:16.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f5554a0d640 1 -- 172.21.15.89:0/3163404710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55500b4a90 msgr2=0x7f55500b9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:16.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3163404710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55500b4a90 0x7f55500b9a60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f55500664a0 tx=0x7f554802b7a0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f5554a0d640 1 -- 172.21.15.89:0/3163404710 shutdown_connections 2023-08-25T10:07:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3163404710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55500b4a90 0x7f55500b9a60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3163404710 >> v2:172.21.15.121:3300/0 conn(0x7f55501494a0 0x7f555006d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.868+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3163404710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.869+0000 7f5554a0d640 1 -- 172.21.15.89:0/3163404710 >> 172.21.15.89:0/3163404710 conn(0x7f55500be090 msgr2=0x7f55500be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.869+0000 7f5554a0d640 1 -- 172.21.15.89:0/3163404710 shutdown_connections 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.869+0000 7f5554a0d640 1 -- 172.21.15.89:0/3163404710 wait complete. 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 Processor -- start 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 -- start start 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55500b4a90 0x7f55501e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55501494a0 0x7f55501e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501d3aa0 con 0x7f55501494a0 2023-08-25T10:07:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555006b110 con 0x7f55500b4a90 2023-08-25T10:07:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.871+0000 7f5554a0d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55501d4db0 con 0x7f555006eba0 2023-08-25T10:07:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f554e59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f554ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55501494a0 0x7f55501e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55500b4a90 0x7f55501e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f554e59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43856/0 (socket says 172.21.15.89:43856) 2023-08-25T10:07:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f554e59c640 1 -- 172.21.15.89:0/3337965138 learned_addr learned my addr 172.21.15.89:0/3337965138 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 -- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 msgr2=0x7f555006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:16.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 -- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55501494a0 msgr2=0x7f55501e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55501494a0 0x7f55501e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 -- 172.21.15.89:0/3337965138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009400 con 0x7f55500b4a90 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f554e59c640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5545d9b640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55500b4a90 0x7f55501e3840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f553800e870 tx=0x7f553800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800ee60 con 0x7f55500b4a90 2023-08-25T10:07:16.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553800c940 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55501d4ad0 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.872+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800ccd0 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.873+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555006c1e0 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.873+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55501d4930 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.874+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5538013470 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.875+0000 7f55477fe640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f553006a050 0x7f553006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.875+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5538088580 con 0x7f55500b4a90 2023-08-25T10:07:16.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.875+0000 7f554e59c640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f553006a050 0x7f553006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:16.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.875+0000 7f554e59c640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f553006a050 0x7f553006c510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5540009fd0 tx=0x7f554000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:16.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:16.880+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f55501d4930 con 0x7f55500b4a90 2023-08-25T10:07:17.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.107+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55501d4930 con 0x7f55500b4a90 2023-08-25T10:07:17.110 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.108+0000 7f55477fe640 1 -- 172.21.15.89:0/3337965138 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18529 (secure 0 0 0) 0x7f55501d4930 con 0x7f55500b4a90 2023-08-25T10:07:17.110 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-08-25T10:07:17.111 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"fsid":"f41429b4-33b6-4950-8ef3-07360119fda9","created":"2023-08-25T09:41:36.486802+0000","modified":"2023-08-25T10:02:16.462881+0000","last_up_change":"2023-08-25T09:41:47.630902+0000","last_in_change":"2023-08-25T09:41:38.743580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T09:41:48.542557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T09:41:54.482852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T09:42:41.332292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T09:42:42.577019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58912273-0517-4f3b-8e17-feddfa2cac01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6809","nonce":857596072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6811","nonce":857596072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6819","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6822","nonce":857596072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6813","nonce":857596072},{"type":"v1","addr":"172.21.15.89:6816","nonce":857596072}]},"public_addr":"172.21.15.89:6809/857596072","cluster_addr":"172.21.15.89:6811/857596072","heartbeat_back_addr":"172.21.15.89:6822/857596072","heartbeat_front_addr":"172.21.15.89:6816/857596072","state":["exists","up"]},{"osd":1,"uuid":"6287559b-ae1f-4a34-a40e-f8b9f77c862c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6801","nonce":2492565919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6803","nonce":2492565919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6807","nonce":2492565919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2492565919},{"type":"v1","addr":"172.21.15.89:6805","nonce":2492565919}]},"public_addr":"172.21.15.89:6801/2492565919","cluster_addr":"172.21.15.89:6803/2492565919","heartbeat_back_addr":"172.21.15.89:6807/2492565919","heartbeat_front_addr":"172.21.15.89:6805/2492565919","state":["exists","up"]},{"osd":2,"uuid":"e5bf404a-f17c-4743-a1bf-3212d9a926ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6815","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6818","nonce":1353688289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6825","nonce":1353688289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6831","nonce":1353688289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6827","nonce":1353688289},{"type":"v1","addr":"172.21.15.89:6829","nonce":1353688289}]},"public_addr":"172.21.15.89:6818/1353688289","cluster_addr":"172.21.15.89:6825/1353688289","heartbeat_back_addr":"172.21.15.89:6831/1353688289","heartbeat_front_addr":"172.21.15.89:6829/1353688289","state":["exists","up"]},{"osd":3,"uuid":"be91dfff-ca51-4056-a5be-650059303ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6814","nonce":2349821925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6817","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6820","nonce":2349821925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6828","nonce":2349821925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6823","nonce":2349821925},{"type":"v1","addr":"172.21.15.89:6824","nonce":2349821925}]},"public_addr":"172.21.15.89:6814/2349821925","cluster_addr":"172.21.15.89:6820/2349821925","heartbeat_back_addr":"172.21.15.89:6828/2349821925","heartbeat_front_addr":"172.21.15.89:6824/2349821925","state":["exists","up"]},{"osd":4,"uuid":"1bdde289-aee9-42f9-8be8-22af818ccd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6801","nonce":2911303023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6803","nonce":2911303023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6807","nonce":2911303023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2911303023},{"type":"v1","addr":"172.21.15.121:6805","nonce":2911303023}]},"public_addr":"172.21.15.121:6801/2911303023","cluster_addr":"172.21.15.121:6803/2911303023","heartbeat_back_addr":"172.21.15.121:6807/2911303023","heartbeat_front_addr":"172.21.15.121:6805/2911303023","state":["exists","up"]},{"osd":5,"uuid":"9c927680-7454-420e-880c-cb01faeeee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6809","nonce":3864449918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6811","nonce":3864449918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6815","nonce":3864449918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3864449918},{"type":"v1","addr":"172.21.15.121:6813","nonce":3864449918}]},"public_addr":"172.21.15.121:6809/3864449918","cluster_addr":"172.21.15.121:6811/3864449918","heartbeat_back_addr":"172.21.15.121:6815/3864449918","heartbeat_front_addr":"172.21.15.121:6813/3864449918","state":["exists","up"]},{"osd":6,"uuid":"fc569826-f7bf-40ee-9683-8f25d96bd17f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6817","nonce":1927368611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6819","nonce":1927368611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6823","nonce":1927368611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1927368611},{"type":"v1","addr":"172.21.15.121:6821","nonce":1927368611}]},"public_addr":"172.21.15.121:6817/1927368611","cluster_addr":"172.21.15.121:6819/1927368611","heartbeat_back_addr":"172.21.15.121:6823/1927368611","heartbeat_front_addr":"172.21.15.121:6821/1927368611","state":["exists","up"]},{"osd":7,"uuid":"15cf9447-ea96-4ab0-bf40-e2522760dc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6825","nonce":1918858390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6827","nonce":1918858390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6831","nonce":1918858390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1918858390},{"type":"v1","addr":"172.21.15.121:6829","nonce":1918858390}]},"public_addr":"172.21.15.121:6825/1918858390","cluster_addr":"172.21.15.121:6827/1918858390","heartbeat_back_addr":"172.21.15.121:6831/1918858390","heartbeat_front_addr":"172.21.15.121:6829/1918858390","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957098+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.833167+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.885047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.901980+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.936886+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.872757+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.963495+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T09:41:43.957633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6837/3523672662":"2023-08-26T10:02:16.462821+0000","172.21.15.89:6836/3523672662":"2023-08-26T10:02:16.462821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T10:07:17.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f553006a050 msgr2=0x7f553006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.112 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f553006a050 0x7f553006c510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5540009fd0 tx=0x7f554000d040 comp rx=0 tx=0).stop 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55500b4a90 msgr2=0x7f55501e3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55500b4a90 0x7f55501e3840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f553800e870 tx=0x7f553800ed30 comp rx=0 tx=0).stop 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 shutdown_connections 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f553006a050 0x7f553006c510 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55501494a0 0x7f55501e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55500b4a90 0x7f55501e3840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.113 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 --2- 172.21.15.89:0/3337965138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f555006eba0 0x7f555006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 >> 172.21.15.89:0/3337965138 conn(0x7f55500be090 msgr2=0x7f5550147af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:17.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 shutdown_connections 2023-08-25T10:07:17.114 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.110+0000 7f5554a0d640 1 -- 172.21.15.89:0/3337965138 wait complete. 2023-08-25T10:07:17.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T09:41:48.542557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T09:41:54.482852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T09:42:41.332292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T09:42:42.577019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T10:07:17.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T10:07:17.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.245+0000 7f3b49be8640 1 Processor -- start 2023-08-25T10:07:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.245+0000 7f3b49be8640 1 -- start start 2023-08-25T10:07:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.245+0000 7f3b49be8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3b44148720 0x7f3b44142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.245+0000 7f3b49be8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440b4850 0x7f3b44142a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b49be8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440b6cd0 con 0x7f3b440bad80 2023-08-25T10:07:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b49be8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b440b59c0 con 0x7f3b44148720 2023-08-25T10:07:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b49be8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440b5f40 con 0x7f3b440b4850 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b42ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3b44148720 0x7f3b44142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b437fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3b440bad80 0x7f3b4414c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58006/0 (socket says 172.21.15.89:58006) 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b437fe640 1 -- 172.21.15.89:0/1194365844 learned_addr learned my addr 172.21.15.89:0/1194365844 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b43fff640 1 --2- 172.21.15.89:0/1194365844 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440b4850 0x7f3b44142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b42ffd640 1 -- 172.21.15.89:0/1194365844 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440b4850 msgr2=0x7f3b44142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b42ffd640 1 --2- 172.21.15.89:0/1194365844 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440b4850 0x7f3b44142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b42ffd640 1 -- 172.21.15.89:0/1194365844 >> v1:172.21.15.89:6789/0 conn(0x7f3b440bad80 legacy=0x7f3b4414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b427fc640 1 -- 172.21.15.89:0/1194365844 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844010507 0 0) 0x7f3b440b6cd0 con 0x7f3b440bad80 2023-08-25T10:07:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.246+0000 7f3b42ffd640 1 -- 172.21.15.89:0/1194365844 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440b5c60 con 0x7f3b44148720 2023-08-25T10:07:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.247+0000 7f3b42ffd640 1 --2- 172.21.15.89:0/1194365844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b44148720 0x7f3b44142510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3b380097a0 tx=0x7f3b3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e4c87b3cbca17a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.247+0000 7f3b427fc640 1 -- 172.21.15.89:0/1194365844 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38030610 con 0x7f3b44148720 2023-08-25T10:07:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.247+0000 7f3b427fc640 1 -- 172.21.15.89:0/1194365844 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38030770 con 0x7f3b44148720 2023-08-25T10:07:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.247+0000 7f3b427fc640 1 -- 172.21.15.89:0/1194365844 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38030b00 con 0x7f3b44148720 2023-08-25T10:07:17.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 -- 172.21.15.89:0/1194365844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b44148720 msgr2=0x7f3b44142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1194365844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b44148720 0x7f3b44142510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3b380097a0 tx=0x7f3b3802b960 comp rx=0 tx=0).stop 2023-08-25T10:07:17.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 -- 172.21.15.89:0/1194365844 shutdown_connections 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1194365844 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440b4850 0x7f3b44142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1194365844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b44148720 0x7f3b44142510 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 -- 172.21.15.89:0/1194365844 >> 172.21.15.89:0/1194365844 conn(0x7f3b4406e560 msgr2=0x7f3b4406e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 -- 172.21.15.89:0/1194365844 shutdown_connections 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.248+0000 7f3b49be8640 1 -- 172.21.15.89:0/1194365844 wait complete. 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.249+0000 7f3b49be8640 1 Processor -- start 2023-08-25T10:07:17.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.249+0000 7f3b49be8640 1 -- start start 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 0x7f3b44143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440bad80 0x7f3b44145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b44148720 0x7f3b441dd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440befc0 con 0x7f3b440b4850 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44144590 con 0x7f3b440bad80 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b441de210 con 0x7f3b44148720 2023-08-25T10:07:17.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 0x7f3b44143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 0x7f3b44143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35230/0 (socket says 172.21.15.89:35230) 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 -- 172.21.15.89:0/1757306437 learned_addr learned my addr 172.21.15.89:0/1757306437 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b43fff640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b44148720 0x7f3b441dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b42ffd640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440bad80 0x7f3b44145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 -- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b44148720 msgr2=0x7f3b441dd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b44148720 0x7f3b441dd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 -- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440bad80 msgr2=0x7f3b44145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440bad80 0x7f3b44145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 -- 172.21.15.89:0/1757306437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009400 con 0x7f3b440b4850 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b437fe640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 0x7f3b44143180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400c500 tx=0x7f3b3400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34007560 con 0x7f3b440b4850 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b340047e0 con 0x7f3b440b4850 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b440bece0 con 0x7f3b440b4850 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34004b90 con 0x7f3b440b4850 2023-08-25T10:07:17.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.250+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b441454f0 con 0x7f3b440b4850 2023-08-25T10:07:17.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.252+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4404dc40 con 0x7f3b440b4850 2023-08-25T10:07:17.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.252+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b34004cf0 con 0x7f3b440b4850 2023-08-25T10:07:17.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.252+0000 7f3b2bfff640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3b3006a050 0x7f3b3006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.252+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f3b34087700 con 0x7f3b440b4850 2023-08-25T10:07:17.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.252+0000 7f3b42ffd640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3b3006a050 0x7f3b3006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.253+0000 7f3b42ffd640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3b3006a050 0x7f3b3006c510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b38036000 tx=0x7f3b3803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:17.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.257+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b34052e20 con 0x7f3b440b4850 2023-08-25T10:07:17.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.546+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b440b8fd0 con 0x7f3b440b4850 2023-08-25T10:07:17.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.547+0000 7f3b2bfff640 1 -- 172.21.15.89:0/1757306437 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b34056440 con 0x7f3b440b4850 2023-08-25T10:07:17.550 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2023-08-25T10:07:17.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3b3006a050 msgr2=0x7f3b3006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3b3006a050 0x7f3b3006c510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b38036000 tx=0x7f3b3803b040 comp rx=0 tx=0).stop 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 msgr2=0x7f3b44143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 0x7f3b44143180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400c500 tx=0x7f3b3400c9c0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 shutdown_connections 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f3b3006a050 0x7f3b3006c510 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b44148720 0x7f3b441dd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440bad80 0x7f3b44145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 --2- 172.21.15.89:0/1757306437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b440b4850 0x7f3b44143180 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.553+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 >> 172.21.15.89:0/1757306437 conn(0x7f3b4406e560 msgr2=0x7f3b44141750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:17.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.556+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 shutdown_connections 2023-08-25T10:07:17.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.558+0000 7f3b49be8640 1 -- 172.21.15.89:0/1757306437 wait complete. 2023-08-25T10:07:17.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T10:07:17.764 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.756+0000 7fae5c47c640 1 Processor -- start 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.756+0000 7fae5c47c640 1 -- start start 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.759+0000 7fae5c47c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae540b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.760+0000 7fae5c47c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fae540b17a0 0x7fae540b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.760+0000 7fae5c47c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540b7960 con 0x7fae540b0e00 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.760+0000 7fae5c47c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540b2520 con 0x7fae540b17a0 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.760+0000 7fae5c47c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5415ba10 con 0x7fae5406c100 2023-08-25T10:07:17.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.761+0000 7fae5a218640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae540b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.761+0000 7fae5a218640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae540b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43894/0 (socket says 172.21.15.89:43894) 2023-08-25T10:07:17.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.761+0000 7fae5a218640 1 -- 172.21.15.89:0/1715330182 learned_addr learned my addr 172.21.15.89:0/1715330182 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:17.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.763+0000 7fae59a17640 1 --2- 172.21.15.89:0/1715330182 >> v2:172.21.15.89:3300/0 conn(0x7fae540b17a0 0x7fae540b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.764+0000 7fae5a218640 1 -- 172.21.15.89:0/1715330182 >> v2:172.21.15.89:3300/0 conn(0x7fae540b17a0 msgr2=0x7fae540b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:17.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.764+0000 7fae5a218640 1 --2- 172.21.15.89:0/1715330182 >> v2:172.21.15.89:3300/0 conn(0x7fae540b17a0 0x7fae540b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.764+0000 7fae5a218640 1 -- 172.21.15.89:0/1715330182 >> v1:172.21.15.89:6789/0 conn(0x7fae540b0e00 legacy=0x7fae540b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.764+0000 7fae5a218640 1 -- 172.21.15.89:0/1715330182 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5406ed90 con 0x7fae5406c100 2023-08-25T10:07:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.765+0000 7fae59a17640 1 --2- 172.21.15.89:0/1715330182 >> v2:172.21.15.89:3300/0 conn(0x7fae540b17a0 0x7fae540b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T10:07:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.765+0000 7fae5a218640 1 --2- 172.21.15.89:0/1715330182 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae540b7dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae4c008ec0 tx=0x7fae4c02e380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26408d7f17118e3f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.765+0000 7fae59216640 1 -- 172.21.15.89:0/1715330182 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c033710 con 0x7fae5406c100 2023-08-25T10:07:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.765+0000 7fae59216640 1 -- 172.21.15.89:0/1715330182 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c031050 con 0x7fae5406c100 2023-08-25T10:07:17.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.765+0000 7fae59216640 1 -- 172.21.15.89:0/1715330182 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c033a70 con 0x7fae5406c100 2023-08-25T10:07:17.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.766+0000 7fae5c47c640 1 -- 172.21.15.89:0/1715330182 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 msgr2=0x7fae540b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.766+0000 7fae5c47c640 1 --2- 172.21.15.89:0/1715330182 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae540b7dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae4c008ec0 tx=0x7fae4c02e380 comp rx=0 tx=0).stop 2023-08-25T10:07:17.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.767+0000 7fae5c47c640 1 -- 172.21.15.89:0/1715330182 shutdown_connections 2023-08-25T10:07:17.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.767+0000 7fae5c47c640 1 --2- 172.21.15.89:0/1715330182 >> v2:172.21.15.89:3300/0 conn(0x7fae540b17a0 0x7fae540b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.767+0000 7fae5c47c640 1 --2- 172.21.15.89:0/1715330182 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae540b7dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.767+0000 7fae5c47c640 1 -- 172.21.15.89:0/1715330182 >> 172.21.15.89:0/1715330182 conn(0x7fae540b8850 msgr2=0x7fae540b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:17.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.767+0000 7fae5c47c640 1 -- 172.21.15.89:0/1715330182 shutdown_connections 2023-08-25T10:07:17.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.767+0000 7fae5c47c640 1 -- 172.21.15.89:0/1715330182 wait complete. 2023-08-25T10:07:17.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.768+0000 7fae5c47c640 1 Processor -- start 2023-08-25T10:07:17.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.768+0000 7fae5c47c640 1 -- start start 2023-08-25T10:07:17.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.769+0000 7fae5c47c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae54156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.769+0000 7fae5c47c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 0x7fae540b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.769+0000 7fae5c47c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae540b17a0 0x7fae540b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.769+0000 7fae5c47c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae54156a70 con 0x7fae540b0e00 2023-08-25T10:07:17.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.769+0000 7fae5c47c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae540b2f80 con 0x7fae540b17a0 2023-08-25T10:07:17.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.769+0000 7fae5c47c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae540b43d0 con 0x7fae5406c100 2023-08-25T10:07:17.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.770+0000 7fae59a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 0x7fae540b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.770+0000 7fae59a17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 0x7fae540b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35244/0 (socket says 172.21.15.89:35244) 2023-08-25T10:07:17.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.770+0000 7fae59a17640 1 -- 172.21.15.89:0/2711199138 learned_addr learned my addr 172.21.15.89:0/2711199138 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:17.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.770+0000 7fae5aa19640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae540b17a0 0x7fae540b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.770+0000 7fae5a218640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae54156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae59a17640 1 -- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 msgr2=0x7fae54156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae59a17640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae54156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae59a17640 1 -- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae540b17a0 msgr2=0x7fae540b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae59a17640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae540b17a0 0x7fae540b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae59a17640 1 -- 172.21.15.89:0/2711199138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c008b20 con 0x7fae540b0e00 2023-08-25T10:07:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae59a17640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 0x7fae540b5120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c820 tx=0x7fae4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44007a30 con 0x7fae540b0e00 2023-08-25T10:07:17.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae540b4640 con 0x7fae540b0e00 2023-08-25T10:07:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.771+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae540b4c00 con 0x7fae540b0e00 2023-08-25T10:07:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.773+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44007b90 con 0x7fae540b0e00 2023-08-25T10:07:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.774+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400ce10 con 0x7fae540b0e00 2023-08-25T10:07:17.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.774+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae440113f0 con 0x7fae540b0e00 2023-08-25T10:07:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.775+0000 7fae4affd640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fae3806a050 0x7fae3806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.775+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fae440885e0 con 0x7fae540b0e00 2023-08-25T10:07:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.775+0000 7fae5a218640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fae3806a050 0x7fae3806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:17.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.776+0000 7fae5a218640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fae3806a050 0x7fae3806c510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fae4c038000 tx=0x7fae4c033000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:17.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.776+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c005250 con 0x7fae540b0e00 2023-08-25T10:07:17.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:17.785+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fae44053df0 con 0x7fae540b0e00 2023-08-25T10:07:18.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.144+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae3c005a80 con 0x7fae540b0e00 2023-08-25T10:07:18.146 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.144+0000 7fae4affd640 1 -- 172.21.15.89:0/2711199138 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae4401f020 con 0x7fae540b0e00 2023-08-25T10:07:18.146 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 8 2023-08-25T10:07:18.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.148+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fae3806a050 msgr2=0x7fae3806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:18.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.149+0000 7fae5c47c640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fae3806a050 0x7fae3806c510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fae4c038000 tx=0x7fae4c033000 comp rx=0 tx=0).stop 2023-08-25T10:07:18.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.149+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 msgr2=0x7fae540b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:18.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.149+0000 7fae5c47c640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 0x7fae540b5120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c820 tx=0x7fae4400cce0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.149+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 shutdown_connections 2023-08-25T10:07:18.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.149+0000 7fae5c47c640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7fae3806a050 0x7fae3806c510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.149+0000 7fae5c47c640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae540b0e00 0x7fae540b5120 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.150+0000 7fae5c47c640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae540b17a0 0x7fae540b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.150+0000 7fae5c47c640 1 --2- 172.21.15.89:0/2711199138 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae5406c100 0x7fae54156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.152 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.150+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 >> 172.21.15.89:0/2711199138 conn(0x7fae540b8850 msgr2=0x7fae540a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:18.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.150+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 shutdown_connections 2023-08-25T10:07:18.153 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.150+0000 7fae5c47c640 1 -- 172.21.15.89:0/2711199138 wait complete. 2023-08-25T10:07:18.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T10:07:18.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.391+0000 7f37e2283640 1 Processor -- start 2023-08-25T10:07:18.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.391+0000 7f37e2283640 1 -- start start 2023-08-25T10:07:18.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.392+0000 7f37e2283640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f37dc06b780 0x7f37dc0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:18.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.392+0000 7f37e2283640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37dc14c310 0x7f37dc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:18.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.392+0000 7f37e2283640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc06e470 con 0x7f37dc06f270 2023-08-25T10:07:18.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.392+0000 7f37e2283640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc070370 con 0x7f37dc14c310 2023-08-25T10:07:18.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.392+0000 7f37e2283640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc06fbf0 con 0x7f37dc06b780 2023-08-25T10:07:18.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37dc14c310 0x7f37dc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:18.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37dc14c310 0x7f37dc06f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35254/0 (socket says 172.21.15.89:35254) 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 -- 172.21.15.89:0/1759046779 learned_addr learned my addr 172.21.15.89:0/1759046779 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37db7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f37dc06f270 0x7f37dc14bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58020/0 (socket says 172.21.15.89:58020) 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37dbfff640 1 --2- 172.21.15.89:0/1759046779 >> v2:172.21.15.121:3300/0 conn(0x7f37dc06b780 0x7f37dc0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 -- 172.21.15.89:0/1759046779 >> v2:172.21.15.121:3300/0 conn(0x7f37dc06b780 msgr2=0x7f37dc0b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 --2- 172.21.15.89:0/1759046779 >> v2:172.21.15.121:3300/0 conn(0x7f37dc06b780 0x7f37dc0b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 -- 172.21.15.89:0/1759046779 >> v1:172.21.15.89:6789/0 conn(0x7f37dc06f270 legacy=0x7f37dc14bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:18.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.393+0000 7f37e0820640 1 -- 172.21.15.89:0/1759046779 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0b61b0 con 0x7f37dc14c310 2023-08-25T10:07:18.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.394+0000 7f37e0820640 1 --2- 172.21.15.89:0/1759046779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc14c310 0x7f37dc06f6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06c080 tx=0x7f37d402be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82c33ac3b3aad69 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:18.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.395+0000 7f37daffd640 1 -- 172.21.15.89:0/1759046779 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d402ca10 con 0x7f37dc14c310 2023-08-25T10:07:18.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.395+0000 7f37daffd640 1 -- 172.21.15.89:0/1759046779 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d402cb70 con 0x7f37dc14c310 2023-08-25T10:07:18.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.396+0000 7f37e2283640 1 -- 172.21.15.89:0/1759046779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc14c310 msgr2=0x7f37dc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:18.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.396+0000 7f37e2283640 1 --2- 172.21.15.89:0/1759046779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc14c310 0x7f37dc06f6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06c080 tx=0x7f37d402be70 comp rx=0 tx=0).stop 2023-08-25T10:07:18.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.398+0000 7f37e2283640 1 -- 172.21.15.89:0/1759046779 shutdown_connections 2023-08-25T10:07:18.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.399+0000 7f37e2283640 1 --2- 172.21.15.89:0/1759046779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc14c310 0x7f37dc06f6b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.399+0000 7f37e2283640 1 --2- 172.21.15.89:0/1759046779 >> v2:172.21.15.121:3300/0 conn(0x7f37dc06b780 0x7f37dc0b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.399+0000 7f37e2283640 1 -- 172.21.15.89:0/1759046779 >> 172.21.15.89:0/1759046779 conn(0x7f37dc0bbd20 msgr2=0x7f37dc0bc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:18.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.399+0000 7f37e2283640 1 -- 172.21.15.89:0/1759046779 shutdown_connections 2023-08-25T10:07:18.401 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.399+0000 7f37e2283640 1 -- 172.21.15.89:0/1759046779 wait complete. 2023-08-25T10:07:18.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.401+0000 7f37e2283640 1 Processor -- start 2023-08-25T10:07:18.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.401+0000 7f37e2283640 1 -- start start 2023-08-25T10:07:18.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37e2283640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc06b780 0x7f37dc1e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:18.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37e2283640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 0x7f37dc0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:18.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37e2283640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37dc14c310 0x7f37dc143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:18.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37e2283640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1e7c30 con 0x7f37dc06b780 2023-08-25T10:07:18.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37e2283640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc14dc20 con 0x7f37dc14c310 2023-08-25T10:07:18.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37e2283640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1e7950 con 0x7f37dc06f270 2023-08-25T10:07:18.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37db7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 0x7f37dc0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:18.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37db7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 0x7f37dc0b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.89:43914/0 (socket says 172.21.15.89:43914) 2023-08-25T10:07:18.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.402+0000 7f37db7fe640 1 -- 172.21.15.89:0/3631866789 learned_addr learned my addr 172.21.15.89:0/3631866789 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:18.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37dbfff640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc06b780 0x7f37dc1e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:18.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37db7fe640 1 -- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37dc14c310 msgr2=0x7f37dc143150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T10:07:18.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37db7fe640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37dc14c310 0x7f37dc143150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37db7fe640 1 -- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc06b780 msgr2=0x7f37dc1e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:18.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37db7fe640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc06b780 0x7f37dc1e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37db7fe640 1 -- 172.21.15.89:0/3631866789 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009b30 con 0x7f37dc06f270 2023-08-25T10:07:18.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.403+0000 7f37db7fe640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 0x7f37dc0b3a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00c480 tx=0x7f37cc00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:18.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.404+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc007480 con 0x7f37dc06f270 2023-08-25T10:07:18.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.404+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc0075e0 con 0x7f37dc06f270 2023-08-25T10:07:18.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.404+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0b3220 con 0x7f37dc06f270 2023-08-25T10:07:18.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.404+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc005a30 con 0x7f37dc06f270 2023-08-25T10:07:18.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.404+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc14e2b0 con 0x7f37dc06f270 2023-08-25T10:07:18.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.407+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f37cc005b90 con 0x7f37dc06f270 2023-08-25T10:07:18.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.407+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0b3740 con 0x7f37dc06f270 2023-08-25T10:07:18.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.407+0000 7f37d8ff9640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37c806a050 0x7f37c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:18.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.407+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f37cc087b10 con 0x7f37dc06f270 2023-08-25T10:07:18.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.408+0000 7f37dbfff640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37c806a050 0x7f37c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:18.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.408+0000 7f37dbfff640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37c806a050 0x7f37c806c510 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37d0006fd0 tx=0x7f37d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:18.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.417+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f37dc0b3740 con 0x7f37dc06f270 2023-08-25T10:07:18.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.769+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37dc0b3740 con 0x7f37dc06f270 2023-08-25T10:07:18.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.770+0000 7f37d8ff9640 1 -- 172.21.15.89:0/3631866789 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37dc0b3740 con 0x7f37dc06f270 2023-08-25T10:07:18.772 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 32 2023-08-25T10:07:18.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.772+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37c806a050 msgr2=0x7f37c806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:18.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37c806a050 0x7f37c806c510 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37d0006fd0 tx=0x7f37d0008040 comp rx=0 tx=0).stop 2023-08-25T10:07:18.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 msgr2=0x7f37dc0b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:18.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 0x7f37dc0b3a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00c480 tx=0x7f37cc00c940 comp rx=0 tx=0).stop 2023-08-25T10:07:18.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 shutdown_connections 2023-08-25T10:07:18.775 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f37c806a050 0x7f37c806c510 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37dc14c310 0x7f37dc143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37dc06f270 0x7f37dc0b3a20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 --2- 172.21.15.89:0/3631866789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37dc06b780 0x7f37dc1e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:18.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.773+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 >> 172.21.15.89:0/3631866789 conn(0x7f37dc0bbd20 msgr2=0x7f37dc14a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:18.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.776+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 shutdown_connections 2023-08-25T10:07:18.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:18.776+0000 7f37e2283640 1 -- 172.21.15.89:0/3631866789 wait complete. 2023-08-25T10:07:18.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T10:07:19.018 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.016+0000 7f549d3c9640 1 Processor -- start 2023-08-25T10:07:19.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.016+0000 7f549d3c9640 1 -- start start 2023-08-25T10:07:19.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.017+0000 7f549d3c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5498069ac0 0x7f549806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.017+0000 7f549d3c9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f549814a490 0x7f5498151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.017+0000 7f549d3c9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54980b86d0 con 0x7f5498140850 2023-08-25T10:07:19.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.017+0000 7f549d3c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54980700e0 con 0x7f5498069ac0 2023-08-25T10:07:19.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.017+0000 7f549d3c9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549806ef10 con 0x7f549814a490 2023-08-25T10:07:19.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f549814a490 0x7f5498151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f549814a490 0x7f5498151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:57212/0 (socket says 172.21.15.89:57212) 2023-08-25T10:07:19.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 -- 172.21.15.89:0/1543743716 learned_addr learned my addr 172.21.15.89:0/1543743716 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:19.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f5496ffd640 1 --2- 172.21.15.89:0/1543743716 >> v2:172.21.15.89:3300/0 conn(0x7f5498069ac0 0x7f549806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 -- 172.21.15.89:0/1543743716 >> v2:172.21.15.89:3300/0 conn(0x7f5498069ac0 msgr2=0x7f549806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:19.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 --2- 172.21.15.89:0/1543743716 >> v2:172.21.15.89:3300/0 conn(0x7f5498069ac0 0x7f549806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 -- 172.21.15.89:0/1543743716 >> v1:172.21.15.121:6789/0 conn(0x7f5498140850 legacy=0x7f5498149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.018+0000 7f54977fe640 1 -- 172.21.15.89:0/1543743716 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549806fa20 con 0x7f549814a490 2023-08-25T10:07:19.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.022+0000 7f5496ffd640 1 --2- 172.21.15.89:0/1543743716 >> v2:172.21.15.89:3300/0 conn(0x7f5498069ac0 0x7f549806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T10:07:19.023 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.022+0000 7f54977fe640 1 --2- 172.21.15.89:0/1543743716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f549814a490 0x7f5498151110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f549814aea0 tx=0x7f549002e2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f6e8024e185c4a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:19.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.022+0000 7f5495ffb640 1 -- 172.21.15.89:0/1543743716 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490038600 con 0x7f549814a490 2023-08-25T10:07:19.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.022+0000 7f5495ffb640 1 -- 172.21.15.89:0/1543743716 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490032070 con 0x7f549814a490 2023-08-25T10:07:19.024 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.022+0000 7f5495ffb640 1 -- 172.21.15.89:0/1543743716 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490038960 con 0x7f549814a490 2023-08-25T10:07:19.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.024+0000 7f549d3c9640 1 -- 172.21.15.89:0/1543743716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f549814a490 msgr2=0x7f5498151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.024+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1543743716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f549814a490 0x7f5498151110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f549814aea0 tx=0x7f549002e2c0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.024+0000 7f549d3c9640 1 -- 172.21.15.89:0/1543743716 shutdown_connections 2023-08-25T10:07:19.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.024+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1543743716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f549814a490 0x7f5498151110 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.024+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1543743716 >> v2:172.21.15.89:3300/0 conn(0x7f5498069ac0 0x7f549806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.026 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.024+0000 7f549d3c9640 1 -- 172.21.15.89:0/1543743716 >> 172.21.15.89:0/1543743716 conn(0x7f54980bbe80 msgr2=0x7f54980bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:19.028 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.027+0000 7f549d3c9640 1 -- 172.21.15.89:0/1543743716 shutdown_connections 2023-08-25T10:07:19.029 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.027+0000 7f549d3c9640 1 -- 172.21.15.89:0/1543743716 wait complete. 2023-08-25T10:07:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.028+0000 7f549d3c9640 1 Processor -- start 2023-08-25T10:07:19.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 -- start start 2023-08-25T10:07:19.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 0x7f54980b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5498140850 0x7f54980b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f549814a490 0x7f54980b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b6b50 con 0x7f549814a490 2023-08-25T10:07:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498142e10 con 0x7f5498069ac0 2023-08-25T10:07:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.029+0000 7f549d3c9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b3920 con 0x7f5498140850 2023-08-25T10:07:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 0x7f54980b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 0x7f54980b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:57226/0 (socket says 172.21.15.89:57226) 2023-08-25T10:07:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 -- 172.21.15.89:0/1834397230 learned_addr learned my addr 172.21.15.89:0/1834397230 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f54977fe640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f549814a490 0x7f54980b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f54967fc640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5498140850 0x7f54980b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 -- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5498140850 msgr2=0x7f54980b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5498140850 0x7f54980b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 -- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f549814a490 msgr2=0x7f54980b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f549814a490 0x7f54980b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f5496ffd640 1 -- 172.21.15.89:0/1834397230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549000d050 con 0x7f5498069ac0 2023-08-25T10:07:19.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f54967fc640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5498140850 0x7f54980b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T10:07:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.030+0000 7f54977fe640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f549814a490 0x7f54980b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T10:07:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.031+0000 7f5496ffd640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 0x7f54980b33e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f548800c820 tx=0x7f548800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.031+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488007a30 con 0x7f5498069ac0 2023-08-25T10:07:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.031+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488007b90 con 0x7f5498069ac0 2023-08-25T10:07:19.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.031+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800ce70 con 0x7f5498069ac0 2023-08-25T10:07:19.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.031+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54980b5a90 con 0x7f5498069ac0 2023-08-25T10:07:19.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.031+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498144140 con 0x7f5498069ac0 2023-08-25T10:07:19.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.034+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5478005250 con 0x7f5498069ac0 2023-08-25T10:07:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.035+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f548801a450 con 0x7f5498069ac0 2023-08-25T10:07:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.036+0000 7f547f7fe640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f548406a050 0x7f548406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.036+0000 7f54967fc640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f548406a050 0x7f548406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.036+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f548805bd20 con 0x7f5498069ac0 2023-08-25T10:07:19.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.036+0000 7f54967fc640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f548406a050 0x7f548406c510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54980b2950 tx=0x7f548c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:19.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.043+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5488054ae0 con 0x7f5498069ac0 2023-08-25T10:07:19.377 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.376+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5478005a80 con 0x7f5498069ac0 2023-08-25T10:07:19.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.376+0000 7f547f7fe640 1 -- 172.21.15.89:0/1834397230 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f548801f0a0 con 0x7f5498069ac0 2023-08-25T10:07:19.378 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 64 2023-08-25T10:07:19.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.380+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f548406a050 msgr2=0x7f548406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.380+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f548406a050 0x7f548406c510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54980b2950 tx=0x7f548c009040 comp rx=0 tx=0).stop 2023-08-25T10:07:19.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.380+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 msgr2=0x7f54980b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.380+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 0x7f54980b33e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f548800c820 tx=0x7f548800cc20 comp rx=0 tx=0).stop 2023-08-25T10:07:19.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 shutdown_connections 2023-08-25T10:07:19.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f548406a050 0x7f548406c510 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f549814a490 0x7f54980b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.383 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5498140850 0x7f54980b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 --2- 172.21.15.89:0/1834397230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5498069ac0 0x7f54980b33e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 >> 172.21.15.89:0/1834397230 conn(0x7f54980bbe80 msgr2=0x7f549813e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:19.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 shutdown_connections 2023-08-25T10:07:19.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.381+0000 7f549d3c9640 1 -- 172.21.15.89:0/1834397230 wait complete. 2023-08-25T10:07:19.407 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T10:07:19.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.620+0000 7f110870c640 1 Processor -- start 2023-08-25T10:07:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.620+0000 7f110870c640 1 -- start start 2023-08-25T10:07:19.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f110870c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11000b9190 0x7f110006fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f110870c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f110870c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11001410e0 con 0x7f11000b6010 2023-08-25T10:07:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f110870c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1100071710 con 0x7f11000b9190 2023-08-25T10:07:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f110870c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110006efe0 con 0x7f11000700d0 2023-08-25T10:07:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f1106ca9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f11000b6010 0x7f1100146a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58036/0 (socket says 172.21.15.89:58036) 2023-08-25T10:07:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f1106ca9640 1 -- 172.21.15.89:0/1956491250 learned_addr learned my addr 172.21.15.89:0/1956491250 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-08-25T10:07:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f11064a8640 1 --2- 172.21.15.89:0/1956491250 >> v2:172.21.15.121:3300/0 conn(0x7f11000b9190 0x7f110006fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.622+0000 7f1105ca7640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.623+0000 7f11054a6640 1 -- 172.21.15.89:0/1956491250 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206193566 0 0) 0x7f11001410e0 con 0x7f11000b6010 2023-08-25T10:07:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f11054a6640 1 -- 172.21.15.89:0/1956491250 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec003520 con 0x7f11000b6010 2023-08-25T10:07:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f11054a6640 1 -- 172.21.15.89:0/1956491250 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214460558 0 0) 0x7f10ec003520 con 0x7f11000b6010 2023-08-25T10:07:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f11064a8640 1 -- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 msgr2=0x7f11000b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T10:07:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f11064a8640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f11064a8640 1 -- 172.21.15.89:0/1956491250 >> v1:172.21.15.89:6789/0 conn(0x7f11000b6010 legacy=0x7f1100146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f11064a8640 1 -- 172.21.15.89:0/1956491250 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000705d0 con 0x7f11000b9190 2023-08-25T10:07:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.624+0000 7f1105ca7640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T10:07:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.626+0000 7f11064a8640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f110006fb90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009720 tx=0x7f10fc02c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a3e82921307be3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.626+0000 7f11054a6640 1 -- 172.21.15.89:0/1956491250 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80019f0 con 0x7f11000b9190 2023-08-25T10:07:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.626+0000 7f11054a6640 1 -- 172.21.15.89:0/1956491250 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc032570 con 0x7f11000b9190 2023-08-25T10:07:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.626+0000 7f11054a6640 1 -- 172.21.15.89:0/1956491250 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc032900 con 0x7f11000b9190 2023-08-25T10:07:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.627+0000 7f110870c640 1 -- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 msgr2=0x7f110006fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.629 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.627+0000 7f110870c640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f110006fb90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009720 tx=0x7f10fc02c890 comp rx=0 tx=0).stop 2023-08-25T10:07:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.628+0000 7f110870c640 1 -- 172.21.15.89:0/1956491250 shutdown_connections 2023-08-25T10:07:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.628+0000 7f110870c640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.628+0000 7f110870c640 1 --2- 172.21.15.89:0/1956491250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f110006fb90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.628+0000 7f110870c640 1 -- 172.21.15.89:0/1956491250 >> 172.21.15.89:0/1956491250 conn(0x7f1100069850 msgr2=0x7f1100069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:19.630 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.628+0000 7f110870c640 1 -- 172.21.15.89:0/1956491250 shutdown_connections 2023-08-25T10:07:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.628+0000 7f110870c640 1 -- 172.21.15.89:0/1956491250 wait complete. 2023-08-25T10:07:19.631 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.630+0000 7f110870c640 1 Processor -- start 2023-08-25T10:07:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.630+0000 7f110870c640 1 -- start start 2023-08-25T10:07:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f110870c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000baf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f110870c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11000b6010 0x7f11001ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f110870c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f11001e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f110870c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000ba570 con 0x7f11000b6010 2023-08-25T10:07:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f110870c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000b4f60 con 0x7f11000b9190 2023-08-25T10:07:19.633 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f110870c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000b9f20 con 0x7f11000700d0 2023-08-25T10:07:19.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f1106ca9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f11001e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.634 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f1106ca9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f11001e7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.89:57246/0 (socket says 172.21.15.89:57246) 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f1106ca9640 1 -- 172.21.15.89:0/1754070361 learned_addr learned my addr 172.21.15.89:0/1754070361 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.631+0000 7f1105ca7640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11000b6010 0x7f11001ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.632+0000 7f1105ca7640 1 -- 172.21.15.89:0/1754070361 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 msgr2=0x7f11000baf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.632+0000 7f1105ca7640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000baf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.632+0000 7f1105ca7640 1 -- 172.21.15.89:0/1754070361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 msgr2=0x7f11001e7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.632+0000 7f1105ca7640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f11001e7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:19.635 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.632+0000 7f1105ca7640 1 -- 172.21.15.89:0/1754070361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f0009400 con 0x7f11000b6010 2023-08-25T10:07:19.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.632+0000 7f1105ca7640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11000b6010 0x7f11001ce0e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e900 tx=0x7f10f000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:19.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.633+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f000ca00 con 0x7f11000b6010 2023-08-25T10:07:19.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.633+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f000cb60 con 0x7f11000b6010 2023-08-25T10:07:19.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.633+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0013470 con 0x7f11000b6010 2023-08-25T10:07:19.636 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.633+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc009400 con 0x7f11000b6010 2023-08-25T10:07:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.633+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11000b7cf0 con 0x7f11000b6010 2023-08-25T10:07:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.635+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110006e900 con 0x7f11000b6010 2023-08-25T10:07:19.637 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.636+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10f00135d0 con 0x7f11000b6010 2023-08-25T10:07:19.638 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.637+0000 7f10f6ffd640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f10e406a050 0x7f10e406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T10:07:19.639 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.638+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f10f0088760 con 0x7f11000b6010 2023-08-25T10:07:19.640 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.638+0000 7f11064a8640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f10e406a050 0x7f10e406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T10:07:19.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.640+0000 7f11064a8640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f10e406a050 0x7f10e406c510 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10fc037000 tx=0x7f10fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T10:07:19.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:19.643+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f110006e900 con 0x7f11000b6010 2023-08-25T10:07:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.000+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f110006e900 con 0x7f11000b6010 2023-08-25T10:07:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.001+0000 7f10f6ffd640 1 -- 172.21.15.89:0/1754070361 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v37) v1 ==== 80+0+122 (secure 0 0 0) 0x7f110006e900 con 0x7f11000b6010 2023-08-25T10:07:20.003 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6837/3523672662 2023-08-26T10:02:16.462821+0000 2023-08-25T10:07:20.003 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6836/3523672662 2023-08-26T10:02:16.462821+0000 2023-08-25T10:07:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:listed 2 entries 2023-08-25T10:07:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.005+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f10e406a050 msgr2=0x7f10e406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.005+0000 7f110870c640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f10e406a050 0x7f10e406c510 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10fc037000 tx=0x7f10fc008030 comp rx=0 tx=0).stop 2023-08-25T10:07:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.005+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11000b6010 msgr2=0x7f11001ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T10:07:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.005+0000 7f110870c640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11000b6010 0x7f11001ce0e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e900 tx=0x7f10f000edc0 comp rx=0 tx=0).stop 2023-08-25T10:07:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.006+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 shutdown_connections 2023-08-25T10:07:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.006+0000 7f110870c640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:6832/660095854,v1:172.21.15.89:6833/660095854] conn(0x7f10e406a050 0x7f10e406c510 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.006+0000 7f110870c640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11000b6010 0x7f11001ce0e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.006+0000 7f110870c640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11000b9190 0x7f11001e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.006+0000 7f110870c640 1 --2- 172.21.15.89:0/1754070361 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11000700d0 0x7f11000baf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T10:07:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.006+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 >> 172.21.15.89:0/1754070361 conn(0x7f1100069850 msgr2=0x7f1100144be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T10:07:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.007+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 shutdown_connections 2023-08-25T10:07:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-08-25T10:07:20.007+0000 7f110870c640 1 -- 172.21.15.89:0/1754070361 wait complete. 2023-08-25T10:07:20.029 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T10:07:20.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T10:07:20.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-25T10:07:20.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-08-25T10:07:20.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T10:07:20.165 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T10:07:21.725 INFO:tasks.ceph.osd.0:Sent signal 15 2023-08-25T10:07:21.725 INFO:tasks.ceph.osd.1:Sent signal 15 2023-08-25T10:07:21.726 INFO:tasks.ceph.osd.2:Sent signal 15 2023-08-25T10:07:21.726 INFO:tasks.ceph.osd.3:Sent signal 15 2023-08-25T10:07:21.726 INFO:tasks.ceph.osd.4:Sent signal 15 2023-08-25T10:07:21.727 INFO:tasks.ceph.osd.5:Sent signal 15 2023-08-25T10:07:21.727 INFO:tasks.ceph.osd.6:Sent signal 15 2023-08-25T10:07:21.728 INFO:tasks.ceph.osd.7:Sent signal 15 2023-08-25T10:07:21.728 INFO:tasks.ceph.mds.c:Sent signal 15 2023-08-25T10:07:21.729 INFO:tasks.ceph.mds.b:Sent signal 15 2023-08-25T10:07:21.729 INFO:tasks.ceph.mon.a:Sent signal 15 2023-08-25T10:07:21.730 INFO:tasks.ceph.mon.b:Sent signal 15 2023-08-25T10:07:21.730 INFO:tasks.ceph.mon.c:Sent signal 15 2023-08-25T10:07:21.730 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-08-25T10:07:21.730 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-08-25T10:07:21.731 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T10:07:21.726+0000 7f498f412640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 91084) UID: 0 2023-08-25T10:07:21.731 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T10:07:21.726+0000 7f498f412640 -1 osd.4 37 *** Got signal Terminated *** 2023-08-25T10:07:21.732 INFO:tasks.ceph.osd.4.smithi121.stderr:2023-08-25T10:07:21.726+0000 7f498f412640 -1 osd.4 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.732 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T10:07:21.726+0000 7fdeb8449640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 91089) UID: 0 2023-08-25T10:07:21.732 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T10:07:21.726+0000 7fdeb8449640 -1 osd.5 37 *** Got signal Terminated *** 2023-08-25T10:07:21.732 INFO:tasks.ceph.osd.5.smithi121.stderr:2023-08-25T10:07:21.726+0000 7fdeb8449640 -1 osd.5 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.733 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T10:07:21.724+0000 7f071c35e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 91370) UID: 0 2023-08-25T10:07:21.733 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T10:07:21.724+0000 7f071c35e640 -1 osd.0 37 *** Got signal Terminated *** 2023-08-25T10:07:21.733 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-08-25T10:07:21.724+0000 7f071c35e640 -1 osd.0 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.733 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T10:07:21.727+0000 7f30ccd8b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 91094) UID: 0 2023-08-25T10:07:21.733 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T10:07:21.727+0000 7f30ccd8b640 -1 osd.7 37 *** Got signal Terminated *** 2023-08-25T10:07:21.734 INFO:tasks.ceph.osd.7.smithi121.stderr:2023-08-25T10:07:21.727+0000 7f30ccd8b640 -1 osd.7 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.734 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T10:07:21.725+0000 7fe39fe5f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 91373) UID: 0 2023-08-25T10:07:21.734 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T10:07:21.725+0000 7fe39fe5f640 -1 osd.1 37 *** Got signal Terminated *** 2023-08-25T10:07:21.734 INFO:tasks.ceph.osd.1.smithi089.stderr:2023-08-25T10:07:21.725+0000 7fe39fe5f640 -1 osd.1 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.734 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T10:07:21.726+0000 7f7e92951640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 91092) UID: 0 2023-08-25T10:07:21.735 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T10:07:21.726+0000 7f7e92951640 -1 osd.6 37 *** Got signal Terminated *** 2023-08-25T10:07:21.735 INFO:tasks.ceph.osd.6.smithi121.stderr:2023-08-25T10:07:21.726+0000 7f7e92951640 -1 osd.6 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.735 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T10:07:21.725+0000 7fee46bd6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 91374) UID: 0 2023-08-25T10:07:21.735 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T10:07:21.725+0000 7fee46bd6640 -1 osd.2 37 *** Got signal Terminated *** 2023-08-25T10:07:21.736 INFO:tasks.ceph.osd.2.smithi089.stderr:2023-08-25T10:07:21.725+0000 7fee46bd6640 -1 osd.2 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.736 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T10:07:21.725+0000 7efeae2e7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 91377) UID: 0 2023-08-25T10:07:21.736 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T10:07:21.725+0000 7efeae2e7640 -1 osd.3 37 *** Got signal Terminated *** 2023-08-25T10:07:21.736 INFO:tasks.ceph.osd.3.smithi089.stderr:2023-08-25T10:07:21.725+0000 7efeae2e7640 -1 osd.3 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-25T10:07:21.737 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T10:07:21.728+0000 7f393519f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 102231) UID: 0 2023-08-25T10:07:21.737 INFO:tasks.ceph.mds.c.smithi089.stderr:2023-08-25T10:07:21.728+0000 7f393519f640 -1 mds.c *** got signal Terminated *** 2023-08-25T10:07:21.737 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-08-25T10:07:21.728+0000 7f2c9deef640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 91095) UID: 0 2023-08-25T10:07:21.737 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-08-25T10:07:21.728+0000 7f2c9deef640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-08-25T10:07:21.738 INFO:tasks.ceph.mon.a.smithi089.stderr:2023-08-25T10:07:21.729+0000 7f2c986e4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T10:07:21.739 INFO:tasks.ceph.mon.b.smithi121.stderr:2023-08-25T10:07:21.730+0000 7f47e4682640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 90507) UID: 0 2023-08-25T10:07:21.739 INFO:tasks.ceph.mon.b.smithi121.stderr:2023-08-25T10:07:21.730+0000 7f47e4682640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-08-25T10:07:21.739 INFO:tasks.ceph.mon.c.smithi121.stderr:2023-08-25T10:07:21.730+0000 7fdf0f8e8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 90509) UID: 0 2023-08-25T10:07:21.740 INFO:tasks.ceph.mon.c.smithi121.stderr:2023-08-25T10:07:21.730+0000 7fdf0f8e8640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-08-25T10:07:21.740 INFO:tasks.ceph.mds.b.smithi121.stderr:2023-08-25T10:07:21.730+0000 7f125b244640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 97011) UID: 0 2023-08-25T10:07:21.740 INFO:tasks.ceph.mds.b.smithi121.stderr:2023-08-25T10:07:21.730+0000 7f125b244640 -1 mds.b *** got signal Terminated *** 2023-08-25T10:07:21.939 INFO:tasks.ceph.mgr.x.smithi121.stderr:daemon-helper: command crashed with signal 15 2023-08-25T10:07:47.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:07:47.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:07:47.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:17.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:17.209 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:17.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:47.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:47.359 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:47.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:17.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:17.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:17.517 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:47.641 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:47.644 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:47.647 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:17.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:17.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:17.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:47.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:47.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:47.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:18.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:18.073 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:18.076 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:48.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:48.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:48.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:18.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:18.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:18.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:48.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:48.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:48.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:18.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:18.660 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:18.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:48.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:48.796 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:48.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:18.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:18.935 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:18.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:49.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:49.074 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:49.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:19.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:19.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:19.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:49.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:49.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:49.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:19.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:19.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:19.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:49.691 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:49.694 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:49.697 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:19.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:19.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:19.844 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:49.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:49.987 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:49.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:20.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:20.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:20.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:50.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:50.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:50.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:20.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:20.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:20.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:50.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:50.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:50.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:20.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:20.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:20.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:50.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:50.877 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:50.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:21.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:21.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:21.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:51.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:51.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:51.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:21.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:21.329 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:21.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:51.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:51.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:51.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:21.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:21.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:21.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:51.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:51.759 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:51.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:22.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:22.088 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:22.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:52.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:52.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:52.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:22.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:22.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:22.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:52.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:52.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:52.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:22.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:22.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:22.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:52.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:52.935 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:52.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:23.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:23.096 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:23.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:53.277 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:53.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:53.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:23.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:23.435 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:23.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:53.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:53.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:53.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:23.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:23.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:23.744 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:53.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:53.885 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:53.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:24.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:24.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:24.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:54.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:54.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:54.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:24.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:24.335 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:24.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:54.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:54.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:54.477 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:24.644 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:24.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:24.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:54.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:54.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:54.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:24.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:24.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:24.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:55.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:55.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:55.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:25.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:25.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:25.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:55.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:55.376 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:55.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:25.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:25.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:25.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:55.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:55.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:55.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:25.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:25.869 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:25.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:56.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:56.021 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:56.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:26.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:26.357 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:26.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:56.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:56.506 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:56.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:26.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:26.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:26.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:56.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:56.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:56.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:27.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:27.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:27.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:57.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:57.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:57.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:27.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:27.366 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:27.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:57.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:57.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:57.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:27.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:27.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:27.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:57.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:57.797 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:57.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:27.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:27.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:27.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:58.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:58.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:58.097 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:28.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:28.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:28.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:58.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:58.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:58.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:28.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:28.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:28.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:58.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:58.728 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:58.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:28.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:28.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:28.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:59.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:59.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:59.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:29.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:29.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:29.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:59.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:59.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:59.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:29.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:29.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:29.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:59.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:59.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:59.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:30.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:30.013 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:30.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:00.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:00.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:00.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:30.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:30.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:30.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:00.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:00.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:00.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:30.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:30.696 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:30.698 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:01.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:01.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:01.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:31.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:31.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:31.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:01.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:01.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:01.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:31.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:31.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:31.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:01.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:01.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:01.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:31.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:31.958 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:31.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:02.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:02.111 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:02.114 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:32.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:32.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:32.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:02.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:02.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:02.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:32.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:32.643 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:32.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:02.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:02.971 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:02.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:33.187 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:33.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:33.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:03.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:03.489 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:03.492 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:33.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:33.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:33.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:03.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:03.949 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:03.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:34.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:34.159 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:34.161 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:04.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:04.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:04.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:34.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:34.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:34.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:04.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:04.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:04.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:34.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:34.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:34.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:04.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:04.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:04.962 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:35.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:35.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:35.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:05.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:05.247 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:05.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:35.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:35.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:35.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:05.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:05.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:05.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:35.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:35.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:35.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:05.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:05.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:05.987 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:36.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:36.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:36.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:06.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:06.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:06.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:36.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:36.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:36.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:06.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:06.767 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:06.770 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:36.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:36.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:36.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:07.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:07.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:07.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:37.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:37.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:37.496 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:07.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:07.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:07.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:37.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:37.836 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:37.839 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:07.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:07.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:07.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:38.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:38.287 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:38.289 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:08.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:08.426 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:08.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:38.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:38.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:38.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:08.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:08.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:08.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:38.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:38.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:38.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:09.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:09.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:09.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:39.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:39.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:39.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:09.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:09.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:09.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:39.688 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:39.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:39.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:09.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:09.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:09.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:40.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:40.312 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:40.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:10.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:10.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:10.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:40.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:40.754 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:40.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:10.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:10.975 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:10.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:41.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:41.322 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:41.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:11.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:11.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:11.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:41.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:41.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:41.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:11.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:11.860 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:11.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:42.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:42.007 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:42.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:12.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:12.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:12.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:42.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:42.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:42.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:12.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:12.516 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:12.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:42.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:42.655 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:42.657 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:12.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:12.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:12.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:42.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:42.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:42.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:13.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:13.111 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:13.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:43.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:43.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:43.322 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:13.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:13.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:13.466 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:43.615 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:43.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:43.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:13.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:13.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:13.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:44.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:44.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:44.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:14.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:14.485 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:14.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:44.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:44.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:44.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:14.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:14.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:14.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:45.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:45.159 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:45.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:15.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:15.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:15.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:45.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:45.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:45.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:15.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:15.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:15.732 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:45.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:45.954 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:45.957 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:16.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:16.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:16.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:46.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:46.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:46.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:16.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:16.759 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:16.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:46.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:47.031 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:47.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:17.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:17.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:17.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:47.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:47.388 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:47.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:17.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:17.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:17.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:47.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:47.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:47.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:18.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:18.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:18.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:48.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:48.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:48.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:18.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:18.341 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:18.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:48.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:48.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:48.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:18.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:18.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:18.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:48.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:49.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:49.004 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:19.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:19.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:19.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:49.559 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:49.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:49.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:19.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:19.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:19.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:49.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:49.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:49.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:20.083 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:20.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:20.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:50.286 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:50.288 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:50.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:20.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:20.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:20.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:51.039 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:51.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:51.044 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:21.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:21.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:21.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:51.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:51.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:51.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:21.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:21.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:21.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:51.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:51.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:51.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:21.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:21.976 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:21.978 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:52.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:52.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:52.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:22.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:22.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:22.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:52.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:52.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:52.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:22.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:22.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:22.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:52.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:52.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:52.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:23.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:23.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:23.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:53.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:53.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:53.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:23.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:23.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:23.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:53.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:53.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:53.743 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:23.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:23.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:23.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:54.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:54.141 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:54.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:24.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:24.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:24.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:54.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:54.516 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:54.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:24.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:24.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:24.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:54.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:54.826 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:54.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:25.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:25.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:25.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:55.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:55.347 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:55.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:25.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:25.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:25.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:55.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:55.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:55.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:25.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:25.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:25.814 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:55.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:55.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:55.960 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:26.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:26.188 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:26.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:56.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:56.351 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:56.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:26.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:26.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:26.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:56.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:56.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:56.807 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:27.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:27.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:27.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:57.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:57.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:57.225 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:27.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:27.360 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:27.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:57.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:57.501 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:57.503 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:27.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:27.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:27.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:57.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:57.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:57.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:28.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:28.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:28.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:58.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:58.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:58.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:28.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:28.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:28.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:58.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:58.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:58.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:28.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:28.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:28.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:59.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:59.037 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:59.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:29.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:29.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:29.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:59.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:59.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:59.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:29.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:29.611 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:29.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:59.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:59.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:59.843 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:29.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:29.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:29.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:00.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:00.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:00.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:30.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:30.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:30.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:00.643 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:00.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:00.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:30.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:30.793 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:30.795 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:00.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:00.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:00.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:31.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:31.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:31.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:01.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:01.299 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:01.302 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:31.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:31.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:31.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:01.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:01.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:01.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:32.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:32.130 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:32.133 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:02.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:02.335 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:02.337 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:32.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:32.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:32.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:02.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:02.828 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:02.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:32.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:32.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:32.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:03.187 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:03.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:03.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:33.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:33.394 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:33.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:03.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:03.600 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:03.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:33.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:33.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:33.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:04.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:04.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:04.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:34.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:34.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:34.161 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:04.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:04.521 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:04.524 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:34.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:34.767 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:34.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:05.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:05.097 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:05.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:35.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:35.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:35.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:05.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:05.552 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:05.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:35.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:35.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:35.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:05.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:05.826 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:05.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:36.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:36.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:36.035 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:06.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:06.246 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:06.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:36.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:36.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:36.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:06.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:06.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:06.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:36.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:36.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:36.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:07.052 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:07.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:07.058 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:37.257 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:37.260 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:37.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:07.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:07.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:07.468 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:37.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:37.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:37.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:07.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:07.834 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:07.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:38.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:38.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:38.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:08.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:08.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:08.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:38.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:38.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:38.514 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:08.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:08.673 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:08.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:39.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:39.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:39.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:09.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:09.325 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:09.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:39.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:39.488 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:39.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:09.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:09.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:09.720 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:39.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:39.922 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:39.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:10.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:10.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:10.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:40.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:40.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:40.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:10.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:10.578 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:10.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:40.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:40.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:40.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:10.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:10.996 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:10.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:41.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:41.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:41.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:11.360 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:11.363 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:11.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:41.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:41.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:41.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:11.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:11.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:11.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:42.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:42.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:42.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:12.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:12.242 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:12.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:42.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:42.442 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:42.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:12.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:12.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:12.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:42.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:42.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:42.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:13.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:13.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:13.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:43.297 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:43.300 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:43.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:13.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:13.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:13.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:43.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:43.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:43.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:13.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:13.824 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:13.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:43.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:43.963 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:43.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:14.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:14.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:14.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:44.409 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:44.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:44.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:14.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:14.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:14.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:44.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:44.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:44.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:14.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:14.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:14.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:45.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:45.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:45.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:15.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:15.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:15.214 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:45.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:45.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:45.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:15.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:15.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:15.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:45.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:45.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:45.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:15.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:16.000 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:16.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:46.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:46.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:46.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:16.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:16.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:16.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:46.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:46.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:46.468 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:16.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:16.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:16.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:46.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:46.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:46.971 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:17.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:17.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:17.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:47.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:47.359 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:47.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:17.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:17.533 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:17.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:47.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:47.669 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:47.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:17.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:17.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:17.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:48.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:48.105 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:48.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:18.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:18.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:18.275 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:23.290 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-08-25T12:48:48.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:48.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:48.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:18.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:18.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:18.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:48.846 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:48.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:48.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:19.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:19.194 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:19.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:49.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:49.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:49.338 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:19.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:19.516 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:19.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:49.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:49.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:49.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:19.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:19.793 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:19.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:49.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:49.997 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:50.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:20.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:20.151 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:20.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:50.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:50.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:50.407 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:20.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:20.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:20.849 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:51.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:51.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:51.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:21.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:21.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:21.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:51.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:51.592 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:51.595 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:21.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:21.739 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:21.741 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:52.000 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:52.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:52.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:22.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:22.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:22.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:52.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:52.489 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:52.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:22.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:22.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:22.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:52.931 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:52.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:52.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:23.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:23.138 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:23.140 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:53.357 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:53.360 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:53.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:23.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:23.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:23.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:53.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:53.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:53.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:24.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:24.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:24.136 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:54.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:54.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:54.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:24.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:24.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:24.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:54.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:54.857 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:54.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:25.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:25.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:25.097 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:55.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:55.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:55.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:25.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:25.456 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:25.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:55.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:55.601 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:55.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:25.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:25.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:25.745 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:55.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:55.905 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:55.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:26.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:26.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:26.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:56.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:56.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:56.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:11.224 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-08-25T13:07:26.559 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:26.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:26.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:56.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:56.758 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:56.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:26.935 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:26.938 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:26.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:57.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:57.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:57.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:27.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:27.288 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:27.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:57.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:57.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:57.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:27.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:27.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:27.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:58.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:58.113 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:58.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:28.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:28.550 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:28.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:58.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:58.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:58.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:29.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:29.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:29.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:59.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:59.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:59.180 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:29.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:29.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:29.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:59.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:59.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:59.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:29.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:29.852 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:29.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:00.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:00.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:00.007 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:30.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:30.168 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:30.170 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:00.371 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:00.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:00.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:30.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:30.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:30.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:00.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:00.733 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:00.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:30.934 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:30.937 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:30.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:01.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:01.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:01.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:31.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:31.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:31.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:01.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:01.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:01.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:31.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:31.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:31.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:02.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:02.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:02.056 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:32.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:32.258 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:32.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:02.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:02.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:02.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:32.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:32.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:32.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:02.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:02.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:02.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:33.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:33.053 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:33.055 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:03.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:03.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:03.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:33.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:33.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:33.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:03.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:03.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:03.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:33.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:33.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:33.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:04.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:04.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:04.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:34.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:34.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:34.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:04.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:04.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:04.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:34.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:34.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:34.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:04.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:04.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:04.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:35.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:35.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:35.049 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:05.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:05.360 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:05.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:35.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:35.582 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:35.584 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:05.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:05.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:05.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:35.908 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:35.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:35.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:06.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:06.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:06.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:36.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:36.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:36.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:06.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:06.523 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:06.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:36.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:36.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:36.844 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:07.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:07.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:07.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:37.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:37.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:37.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:07.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:07.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:07.584 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:37.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:37.800 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:37.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:08.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:08.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:08.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:38.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:38.196 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:38.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:08.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:08.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:08.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:38.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:38.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:38.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:08.980 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:08.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:08.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:39.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:39.151 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:39.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:09.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:09.389 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:09.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:39.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:39.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:39.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:09.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:09.935 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:09.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:40.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:40.137 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:40.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:10.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:10.280 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:10.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:40.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:40.516 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:40.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:10.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:10.753 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:10.770 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:40.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:40.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:40.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:11.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:11.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:11.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:41.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:41.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:41.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:11.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:11.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:11.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:41.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:41.728 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:41.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:11.890 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:11.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:11.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:42.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:42.113 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:42.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:12.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:12.327 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:12.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:42.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:42.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:42.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:12.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:12.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:12.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:42.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:42.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:42.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:12.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:12.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:12.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:43.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:43.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:43.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:13.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:13.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:13.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:43.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:43.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:43.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:13.533 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:13.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:13.539 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:43.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:43.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:43.748 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:13.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:13.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:13.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:44.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:44.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:44.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:14.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:14.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:14.340 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:44.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:44.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:44.567 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:14.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:14.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:14.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:44.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:44.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:44.878 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:15.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:15.140 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:15.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:45.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:45.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:45.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:15.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:15.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:15.485 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:45.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:45.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:45.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:16.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:16.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:16.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:46.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:46.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:46.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:16.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:16.428 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:16.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:46.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:46.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:46.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:16.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:16.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:16.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:47.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:47.144 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:47.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:17.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:17.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:17.510 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:47.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:47.728 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:47.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:17.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:17.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:17.869 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:48.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:48.144 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:48.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:18.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:18.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:18.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:48.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:48.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:48.551 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:18.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:18.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:18.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:48.846 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:48.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:48.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:18.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:18.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:18.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:49.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:49.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:49.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:19.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:19.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:19.275 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:49.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:49.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:49.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:19.639 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:19.642 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:19.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:49.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:49.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:49.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:20.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:20.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:20.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:50.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:50.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:50.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:20.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:20.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:20.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:50.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:50.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:50.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:20.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:20.765 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:20.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:50.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:50.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:50.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:21.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:21.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:21.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:51.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:51.212 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:51.214 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:21.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:21.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:21.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:51.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:51.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:51.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:21.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:21.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:21.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:51.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:51.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:51.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:22.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:22.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:22.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:52.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:52.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:52.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:22.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:22.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:22.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:52.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:52.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:52.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:22.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:22.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:22.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:53.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:53.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:53.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:23.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:23.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:23.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:53.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:53.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:53.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:23.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:23.677 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:23.679 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:53.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:53.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:53.902 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:24.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:24.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:24.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:54.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:54.526 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:54.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:24.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:24.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:24.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:54.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:54.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:54.839 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:25.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:25.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:25.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:55.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:55.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:55.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:25.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:25.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:25.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:55.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:55.697 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:55.700 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:25.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:25.919 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:25.921 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:56.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:56.149 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:56.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:26.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:26.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:26.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:56.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:56.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:56.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:26.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:26.797 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:26.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:57.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:57.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:57.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:27.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:27.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:27.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:57.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:57.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:57.400 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:27.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:27.603 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:27.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:57.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:57.826 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:57.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:28.052 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:28.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:28.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:58.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:58.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:58.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:28.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:28.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:28.397 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:58.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:58.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:58.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:28.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:28.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:28.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:58.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:58.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:58.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:29.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:29.182 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:29.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:59.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:59.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:59.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:29.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:29.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:29.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:59.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:59.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:59.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:29.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:29.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:29.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:00.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:00.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:00.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:30.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:30.343 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:30.345 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:00.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:00.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:00.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:30.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:30.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:30.846 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:01.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:01.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:01.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:31.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:31.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:31.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:01.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:01.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:01.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:31.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:31.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:31.657 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:01.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:01.816 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:01.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:31.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:31.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:31.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:02.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:02.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:02.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:32.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:32.407 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:32.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:02.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:02.588 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:02.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:32.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:32.792 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:32.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:03.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:03.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:03.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:33.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:33.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:33.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:03.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:03.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:03.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:33.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:33.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:33.595 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:03.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:03.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:03.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:34.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:34.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:34.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:04.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:04.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:04.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:34.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:34.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:34.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:04.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:04.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:04.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:34.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:34.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:34.887 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:05.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:05.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:05.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:35.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:35.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:35.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:05.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:05.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:05.768 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:35.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:35.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:35.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:06.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:06.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:06.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:36.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:36.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:36.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:06.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:06.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:06.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:36.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:36.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:36.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:06.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:06.848 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:06.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:37.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:37.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:37.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:07.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:07.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:07.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:37.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:37.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:37.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:07.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:07.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:07.670 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:37.868 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:37.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:37.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:08.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:08.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:08.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:38.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:38.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:38.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:08.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:08.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:08.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:38.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:38.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:38.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:09.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:09.021 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:09.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:39.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:39.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:39.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:09.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:09.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:09.300 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:39.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:39.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:39.480 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:09.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:09.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:09.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:39.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:39.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:39.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:09.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:09.987 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:09.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:40.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:40.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:40.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:10.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:10.473 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:10.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:40.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:40.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:40.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:10.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:10.869 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:10.871 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:41.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:41.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:41.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:11.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:11.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:11.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:41.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:41.423 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:41.425 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:11.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:11.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:11.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:41.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:41.716 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:41.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:11.917 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:11.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:11.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:42.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:42.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:42.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:12.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:12.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:12.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:42.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:42.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:42.479 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:12.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:12.614 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:12.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:42.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:42.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:42.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:12.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:12.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:12.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:43.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:43.114 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:43.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:13.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:13.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:13.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:43.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:43.400 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:43.403 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:13.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:13.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:13.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:43.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:43.692 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:43.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:13.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:13.857 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:13.859 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:44.000 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:44.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:44.007 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:14.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:14.140 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:14.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:44.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:44.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:44.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:14.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:14.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:14.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:44.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:44.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:44.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:15.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:15.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:15.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:45.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:45.291 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:45.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:15.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:15.487 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:15.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:45.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:45.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:45.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:15.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:15.905 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:15.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:46.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:46.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:46.218 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:16.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:16.551 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:16.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:46.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:46.696 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:46.699 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:16.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:16.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:16.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:47.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:47.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:47.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:17.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:17.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:17.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:47.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:47.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:47.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:17.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:17.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:17.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:47.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:47.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:47.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:18.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:18.073 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:18.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:48.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:48.287 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:48.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:18.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:18.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:18.520 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:48.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:48.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:48.743 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:18.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:18.903 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:18.906 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:49.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:49.117 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:49.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:19.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:19.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:19.264 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:49.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:49.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:49.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:19.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:19.554 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:19.557 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:49.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:49.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:49.779 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:20.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:20.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:20.026 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:50.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:50.170 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:50.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:20.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:20.550 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:20.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:50.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:50.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:50.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:20.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:20.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:20.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:51.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:51.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:51.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:21.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:21.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:21.382 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:51.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:51.527 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:51.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:21.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:21.731 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:21.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:52.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:52.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:52.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:22.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:22.312 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:22.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:52.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:52.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:52.468 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:22.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:22.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:22.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:53.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:53.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:53.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:23.286 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:23.289 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:23.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:53.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:53.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:53.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:23.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:23.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:23.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:53.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:53.954 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:53.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:24.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:24.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:24.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:54.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:54.347 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:54.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:24.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:24.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:24.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:54.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:54.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:54.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:24.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:24.913 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:24.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:55.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:55.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:55.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:25.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:25.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:25.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:55.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:55.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:55.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:25.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:25.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:25.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:55.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:55.946 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:55.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:26.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:26.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:26.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:56.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:56.359 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:56.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:26.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:26.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:26.565 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:56.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:56.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:56.779 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:26.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:26.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:26.926 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:57.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:57.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:57.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:27.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:27.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:27.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:57.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:57.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:57.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:27.980 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:27.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:27.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:58.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:58.135 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:58.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:28.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:28.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:28.356 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:58.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:58.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:58.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:28.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:28.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:28.732 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:58.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:58.864 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:58.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:29.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:29.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:29.035 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:59.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:59.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:59.365 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:29.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:29.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:29.520 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:59.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:59.655 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:59.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:29.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:29.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:29.805 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:59.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:59.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:59.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:30.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:30.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:30.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:00.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:00.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:00.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:30.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:30.400 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:30.403 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:00.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:00.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:00.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:30.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:30.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:30.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:00.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:00.925 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:00.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:31.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:31.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:31.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:01.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:01.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:01.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:31.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:31.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:31.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:01.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:01.753 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:01.755 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:31.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:31.965 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:31.967 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:02.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:02.370 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:02.372 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:32.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:32.516 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:32.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:02.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:02.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:02.682 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:32.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:32.884 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:32.887 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:03.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:03.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:03.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:33.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:33.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:33.265 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:03.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:03.484 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:03.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:33.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:33.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:33.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:03.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:03.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:03.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:33.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:33.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:33.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:04.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:04.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:04.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:34.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:34.358 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:34.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:04.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:04.566 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:04.569 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:34.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:34.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:34.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:04.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:04.935 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:04.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:35.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:35.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:35.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:05.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:05.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:05.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:35.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:35.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:35.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:05.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:05.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:05.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:35.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:35.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:35.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:06.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:06.012 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:06.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:36.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:36.427 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:36.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:06.844 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:06.847 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:06.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:37.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:37.007 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:37.009 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:07.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:07.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:07.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:37.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:37.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:37.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:07.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:07.472 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:07.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:37.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:37.690 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:37.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:07.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:07.845 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:07.848 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:38.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:38.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:38.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:08.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:08.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:08.218 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:38.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:38.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:38.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:08.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:08.673 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:08.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:38.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:38.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:38.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:09.039 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:09.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:09.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:39.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:39.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:39.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:09.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:09.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:09.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:39.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:39.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:39.721 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:09.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:09.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:09.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:40.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:40.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:40.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:10.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:10.455 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:10.458 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:40.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:40.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:40.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:10.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:10.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:10.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:41.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:41.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:41.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:11.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:11.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:11.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:41.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:41.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:41.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:11.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:11.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:11.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:41.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:41.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:41.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:11.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:11.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:11.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:42.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:42.075 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:42.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:12.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:12.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:12.300 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:42.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:42.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:42.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:12.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:12.650 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:12.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:42.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:42.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:42.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:13.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:13.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:13.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:43.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:43.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:43.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:13.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:13.325 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:13.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:43.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:43.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:43.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:13.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:13.603 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:13.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:43.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:43.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:43.847 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:13.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:13.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:13.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:44.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:44.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:44.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:14.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:14.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:14.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:44.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:44.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:44.594 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:14.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:14.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:14.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:45.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:45.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:45.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:15.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:15.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:15.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:45.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:45.473 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:45.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:15.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:15.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:15.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:45.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:45.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:45.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:16.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:16.178 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:16.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:46.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:46.407 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:46.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:26:16.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:26:16.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:26:16.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:26:46.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:26:46.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:26:46.779 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:27:17.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:27:17.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:27:17.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:27:47.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:27:47.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:27:47.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:28:17.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:28:17.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:28:17.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:28:47.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:28:47.672 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:28:47.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:29:18.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:29:18.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:29:18.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:29:48.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:29:48.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:29:48.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:30:18.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:30:18.329 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:30:18.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:30:48.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:30:48.552 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:30:48.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:31:18.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:31:18.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:31:18.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:31:48.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:31:48.902 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:31:48.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:32:19.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:32:19.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:32:19.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:32:49.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:32:49.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:32:49.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:33:19.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:33:19.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:33:19.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:33:49.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:33:49.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:33:49.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:34:19.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:34:19.703 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:34:19.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:34:49.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:34:49.852 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:34:49.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:35:20.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:35:20.013 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:35:20.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:35:50.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:35:50.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:35:50.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:36:20.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:36:20.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:36:20.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:36:50.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:36:50.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:36:50.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:37:20.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:37:20.968 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:37:20.971 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:37:51.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:37:51.181 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:37:51.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:38:21.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:38:21.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:38:21.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:38:51.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:38:51.558 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:38:51.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:39:21.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:39:21.762 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:39:21.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:39:51.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:39:51.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:39:51.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:40:22.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:40:22.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:40:22.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:40:52.437 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:40:52.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:40:52.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:41:22.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:41:22.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:41:22.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:41:52.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:41:52.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:41:52.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:42:22.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:42:22.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:42:22.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:42:53.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:42:53.088 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:42:53.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:43:23.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:43:23.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:43:23.338 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:43:53.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:43:53.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:43:53.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:44:23.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:44:23.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:44:23.681 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:44:54.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:44:54.034 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:44:54.036 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:45:24.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:45:24.209 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:45:24.214 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:45:54.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:45:54.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:45:54.472 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:46:24.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:46:24.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:46:24.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:46:54.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:46:54.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:46:54.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:47:24.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:47:24.917 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:47:24.920 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:47:55.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:47:55.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:47:55.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:48:25.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:48:25.212 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:48:25.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:48:55.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:48:55.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:48:55.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:49:25.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:49:25.485 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:49:25.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:49:55.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:49:55.626 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:49:55.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:50:25.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:50:25.831 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:50:25.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:50:56.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:50:56.069 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:50:56.071 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:51:26.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:51:26.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:51:26.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:51:56.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:51:56.554 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:51:56.558 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:52:26.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:52:26.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:52:26.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:52:57.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:52:57.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:52:57.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:53:27.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:53:27.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:53:27.380 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:53:57.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:53:57.590 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:53:57.593 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:54:27.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:54:27.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:54:27.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:54:57.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:54:57.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:54:57.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:55:28.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:55:28.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:55:28.167 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:55:58.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:55:58.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:55:58.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:56:28.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:56:28.450 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:56:28.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:56:58.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:56:58.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:56:58.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:57:28.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:57:28.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:57:28.771 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:57:58.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:57:58.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:57:58.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:58:29.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:58:29.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:58:29.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:58:59.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:58:59.316 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:58:59.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:59:29.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:59:29.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:59:29.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:59:59.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:59:59.760 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:59:59.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:00:29.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:00:29.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:00:29.984 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:01:00.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:01:00.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:01:00.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:01:30.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:01:30.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:01:30.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:02:00.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:02:00.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:02:00.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:02:30.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:02:30.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:02:30.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:03:01.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:03:01.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:03:01.044 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:03:31.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:03:31.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:03:31.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:04:01.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:04:01.392 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:04:01.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:04:31.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:04:31.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:04:31.551 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:05:01.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:05:01.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:05:01.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:05:31.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:05:31.937 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:05:31.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:06:02.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:06:02.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:06:02.086 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:06:32.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:06:32.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:06:32.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:07:02.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:07:02.366 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:07:02.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:07:32.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:07:32.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:07:32.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:08:02.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:08:02.793 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:08:02.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:08:33.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:08:33.006 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:08:33.009 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:09:03.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:09:03.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:09:03.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:09:33.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:09:33.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:09:33.319 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:10:03.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:10:03.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:10:03.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:10:33.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:10:33.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:10:33.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:11:03.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:11:03.946 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:11:03.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:11:34.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:11:34.084 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:11:34.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:12:04.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:12:04.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:12:04.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:12:34.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:12:34.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:12:34.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:13:04.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:13:04.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:13:04.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:13:34.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:13:34.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:13:34.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:14:04.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:14:04.845 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:14:04.848 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:14:34.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:14:34.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:14:34.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:15:05.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:15:05.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:15:05.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:15:35.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:15:35.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:15:35.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:16:05.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:16:05.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:16:05.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:16:35.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:16:35.907 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:16:35.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:17:06.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:17:06.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:17:06.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:17:36.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:17:36.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:17:36.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:18:06.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:18:06.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:18:06.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:18:36.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:18:36.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:18:36.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:19:06.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:19:06.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:19:06.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:19:37.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:19:37.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:19:37.097 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:20:07.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:20:07.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:20:07.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:20:37.492 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:20:37.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:20:37.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:21:07.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:21:07.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:21:07.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:21:37.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:21:37.896 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:21:37.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:22:08.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:22:08.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:22:08.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:22:38.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:22:38.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:22:38.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:23:08.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:23:08.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:23:08.466 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:23:38.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:23:38.717 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:23:38.720 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:24:08.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:24:08.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:24:08.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:24:39.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:24:39.026 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:24:39.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:25:09.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:25:09.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:25:09.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:25:39.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:25:39.329 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:25:39.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:26:09.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:26:09.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:26:09.472 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:26:39.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:26:39.800 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:26:39.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:27:09.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:27:09.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:27:40.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:27:40.116 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:27:40.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:28:10.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:28:10.357 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:28:10.360 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:28:40.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:28:40.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:28:40.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:29:10.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:29:10.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:29:10.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:29:40.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:29:40.955 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:29:40.957 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:30:11.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:30:11.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:30:11.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:30:41.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:30:41.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:30:41.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:31:11.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:31:11.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:31:11.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:31:41.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:31:41.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:31:41.703 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:32:11.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:32:11.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:32:11.858 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:32:42.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:32:42.026 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:32:42.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:33:12.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:33:12.170 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:33:12.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:33:42.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:33:42.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:33:42.425 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:34:12.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:34:12.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:34:12.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:34:43.062 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:34:43.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:34:43.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:35:13.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:35:13.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:35:13.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:35:43.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:35:43.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:35:43.377 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:36:13.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:36:13.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:36:13.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:36:43.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:36:43.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:36:43.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:37:13.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:37:13.975 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:37:13.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:37:44.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:37:44.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:37:44.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:38:14.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:38:14.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:38:14.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:38:44.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:38:44.585 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:38:44.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:39:14.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:39:14.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:39:14.807 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:39:45.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:39:45.118 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:39:45.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:40:15.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:40:15.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:40:15.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:40:45.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:40:45.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:40:45.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:41:15.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:41:15.590 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:41:15.592 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:41:45.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:41:45.834 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:41:45.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:42:15.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:42:15.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:42:15.987 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:42:46.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:42:46.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:42:46.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:43:16.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:43:16.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:43:16.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:43:46.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:43:46.507 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:43:46.509 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:44:16.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:44:16.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:44:16.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:44:46.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:44:46.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:44:46.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:45:16.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:45:16.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:45:16.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:45:47.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:45:47.137 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:45:47.141 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:46:17.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:46:17.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:46:17.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:46:47.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:46:47.487 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:46:47.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:47:17.639 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:47:17.643 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:47:17.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:47:47.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:47:47.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:47:47.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:48:17.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:48:17.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:48:17.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:48:48.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:48:48.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:48:48.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:49:18.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:49:18.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:49:18.322 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:49:48.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:49:48.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:49:48.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:50:18.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:50:18.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:50:18.664 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:50:48.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:50:48.870 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:50:48.872 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:51:19.046 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:51:19.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:51:19.053 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:51:49.200 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:51:49.204 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:51:49.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:52:19.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:52:19.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:52:19.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:52:49.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:52:49.505 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:52:49.507 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:53:19.655 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:53:19.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:53:19.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:53:49.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:53:49.867 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:53:49.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:54:20.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:54:20.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:54:20.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:54:50.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:54:50.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:54:50.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:55:20.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:55:20.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:55:20.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:55:50.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:55:50.756 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:55:50.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:56:20.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:56:20.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:56:20.931 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:56:51.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:56:51.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:56:51.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:57:21.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:57:21.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:57:21.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:57:51.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:57:51.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:57:51.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:58:21.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:58:21.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:58:21.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:58:51.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:58:51.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:58:51.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:59:22.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:59:22.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:59:22.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:59:52.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:59:52.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T17:59:52.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:00:22.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:00:22.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:00:22.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:00:52.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:00:52.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:00:52.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:01:22.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:01:22.885 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:01:22.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:01:53.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:01:53.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:01:53.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:02:23.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:02:23.446 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:02:23.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:02:53.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:02:53.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:02:53.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:03:23.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:03:23.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:03:23.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:03:53.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:03:53.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:03:53.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:04:24.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:04:24.224 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:04:24.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:04:54.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:04:54.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:04:54.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:05:24.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:05:24.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:05:24.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:05:54.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:05:54.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:05:54.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:06:25.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:06:25.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:06:25.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:06:55.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:06:55.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:06:55.220 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:07:25.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:07:25.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:07:25.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:07:55.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:07:55.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:07:55.664 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:08:25.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:08:25.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:08:25.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:08:56.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:08:56.088 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:08:56.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:09:26.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:09:26.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:09:26.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:09:56.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:09:56.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:09:56.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:10:26.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:10:26.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:10:26.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:10:56.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:10:56.758 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:10:56.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:11:26.949 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:11:26.951 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:11:26.954 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:11:57.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:11:57.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:11:57.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:12:27.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:12:27.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:12:27.256 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:12:57.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:12:57.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:12:57.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:13:27.621 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:13:27.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:13:27.629 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:13:57.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:13:57.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:13:57.772 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:14:27.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:14:27.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:14:27.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:14:58.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:14:58.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:14:58.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:15:28.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:15:28.231 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:15:28.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:15:58.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:15:58.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:15:58.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:16:28.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:16:28.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:16:28.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:16:58.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:16:58.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:16:58.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:17:28.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:17:28.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:17:28.890 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:17:59.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:17:59.037 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:17:59.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:18:29.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:18:29.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:18:29.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:18:59.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:18:59.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:18:59.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:19:29.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:19:29.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:19:29.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:19:59.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:19:59.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:19:59.627 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:20:29.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:20:29.762 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:20:29.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:20:59.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:20:59.906 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:20:59.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:21:30.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:21:30.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:21:30.053 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:22:00.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:22:00.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:22:00.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:22:30.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:22:30.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:22:30.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:23:00.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:23:00.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:23:00.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:23:30.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:23:30.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:23:30.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:24:00.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:24:00.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:24:00.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:24:31.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:24:31.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:24:31.089 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:25:01.286 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:25:01.290 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:25:01.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:25:31.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:25:31.505 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:25:31.509 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:26:01.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:26:01.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:26:01.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:26:31.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:26:31.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:26:31.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:27:01.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:27:01.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:27:01.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:27:32.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:27:32.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:27:32.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:28:02.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:28:02.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:28:02.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:28:32.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:28:32.550 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:28:32.553 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:29:02.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:29:02.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:29:02.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:29:32.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:29:32.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:29:32.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:30:03.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:30:03.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:30:03.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:30:33.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:30:33.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:30:33.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:31:03.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:31:03.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:31:03.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:31:33.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:31:33.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:31:33.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:32:03.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:32:03.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:32:03.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:32:34.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:32:34.114 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:32:34.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:33:04.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:33:04.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:33:04.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:33:34.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:33:34.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:33:34.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:34:04.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:34:04.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:34:04.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:34:34.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:34:34.690 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:34:34.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:35:04.827 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:35:04.830 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:35:04.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:35:34.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:35:34.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:35:34.980 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:36:05.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:36:05.119 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:36:05.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:36:35.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:36:35.268 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:36:35.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:37:05.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:37:05.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:37:05.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:37:35.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:37:35.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:37:35.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:38:05.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:38:05.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:38:05.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:38:35.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:38:35.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:38:35.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:39:06.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:39:06.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:39:06.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:39:36.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:39:36.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:39:36.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:40:06.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:40:06.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:40:06.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:40:36.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:40:36.736 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:40:36.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:41:06.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:41:06.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:41:06.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:41:37.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:41:37.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:41:37.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:42:07.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:42:07.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:42:07.289 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:42:37.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:42:37.430 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:42:37.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:43:07.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:43:07.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:43:07.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:43:37.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:43:37.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:43:37.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:44:07.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:44:07.955 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:44:07.958 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:44:38.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:44:38.109 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:44:38.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:45:08.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:45:08.341 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:45:08.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:45:38.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:45:38.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:45:38.563 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:46:08.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:46:08.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:46:08.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:46:38.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:46:38.946 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:46:38.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:47:09.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:47:09.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:47:09.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:47:39.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:47:39.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:47:39.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:48:09.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:48:09.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:48:09.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:48:40.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:48:40.022 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:48:40.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:49:10.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:49:10.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:49:10.265 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:49:40.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:49:40.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:49:40.479 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:50:10.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:50:10.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:50:10.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:50:40.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:50:40.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:50:40.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:51:11.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:51:11.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:51:11.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:51:41.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:51:41.227 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:51:41.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:52:11.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:52:11.450 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:52:11.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:52:41.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:52:41.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:52:41.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:53:11.752 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:53:11.755 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:53:11.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:53:41.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:53:41.907 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:53:41.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:54:12.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:54:12.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:54:12.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:54:42.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:54:42.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:54:42.477 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:55:12.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:55:12.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:55:12.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:55:42.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:55:42.916 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:55:42.919 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:56:13.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:56:13.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:56:13.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:56:43.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:56:43.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:56:43.470 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:57:13.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:57:13.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:57:13.688 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:57:43.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:57:43.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:57:43.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:58:14.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:58:14.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:58:14.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:58:44.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:58:44.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:58:44.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:59:14.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:59:14.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:59:14.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:59:44.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:59:44.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T18:59:44.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:00:14.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:00:14.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:00:14.812 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:00:45.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:00:45.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:00:45.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:01:15.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:01:15.242 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:01:15.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:01:45.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:01:45.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:01:45.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:02:15.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:02:15.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:02:15.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:02:45.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:02:45.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:02:45.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:03:15.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:03:15.903 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:03:15.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:03:46.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:03:46.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:03:46.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:04:16.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:04:16.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:04:16.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:04:46.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:04:46.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:04:46.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:05:16.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:05:16.516 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:05:16.520 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:05:46.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:05:46.673 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:05:46.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:06:16.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:06:16.810 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:06:16.815 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:06:46.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:06:46.949 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:06:46.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:07:17.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:07:17.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:07:17.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:07:47.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:07:47.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:07:47.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:08:17.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:08:17.828 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:08:17.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:08:48.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:08:48.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:08:48.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:09:18.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:09:18.193 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:09:18.195 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:09:48.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:09:48.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:09:48.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:10:18.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:10:18.651 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:10:18.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:10:48.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:10:48.816 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:10:48.820 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:11:19.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:11:19.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:11:19.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:11:49.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:11:49.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:11:49.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:12:19.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:12:19.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:12:19.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:12:49.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:12:49.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:12:49.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:13:20.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:13:20.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:13:20.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:13:50.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:13:50.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:13:50.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:14:20.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:14:20.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:14:20.558 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:14:50.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:14:50.703 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:14:50.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:15:20.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:15:20.845 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:15:20.847 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:15:51.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:15:51.013 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:15:51.016 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:16:21.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:16:21.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:16:21.170 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:16:51.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:16:51.306 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:16:51.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:17:21.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:17:21.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:17:21.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:17:51.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:17:51.734 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:17:51.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:18:21.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:18:21.939 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:18:21.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:18:52.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:18:52.170 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:18:52.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:19:22.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:19:22.322 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:19:22.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:19:52.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:19:52.521 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:19:52.524 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:20:22.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:20:22.734 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:20:22.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:20:52.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:20:52.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:20:52.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:21:23.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:21:23.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:21:23.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:21:53.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:21:53.389 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:21:53.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:22:23.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:22:23.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:22:23.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:22:53.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:22:53.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:22:53.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:23:23.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:23:23.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:23:23.906 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:23:54.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:23:54.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:23:54.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:24:24.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:24:24.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:24:24.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:24:54.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:24:54.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:24:54.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:25:24.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:25:24.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:25:24.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:25:54.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:25:54.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:25:54.902 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:26:25.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:26:25.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:26:25.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:26:55.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:26:55.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:26:55.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:27:25.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:27:25.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:27:25.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:27:55.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:27:55.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:27:55.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:28:25.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:28:25.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:28:25.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:28:56.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:28:56.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:28:56.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:29:26.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:29:26.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:29:26.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:29:56.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:29:56.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:29:56.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:30:26.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:30:26.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:30:26.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:30:56.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:30:56.660 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:30:56.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:31:26.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:31:26.889 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:31:26.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:31:57.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:31:57.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:31:57.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:32:27.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:32:27.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:32:27.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:32:57.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:32:57.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:32:57.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:33:27.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:33:27.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:33:27.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:33:58.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:33:58.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:33:58.007 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:34:28.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:34:28.212 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:34:28.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:34:58.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:34:58.408 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:34:58.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:35:28.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:35:28.639 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:35:28.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:35:58.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:35:58.852 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:35:58.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:36:29.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:36:29.199 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:36:29.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:36:59.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:36:59.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:36:59.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:37:29.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:37:29.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:37:29.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:37:59.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:37:59.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:37:59.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:38:29.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:38:29.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:38:29.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:38:59.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:38:59.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:39:00.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:39:30.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:39:30.145 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:39:30.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:40:00.371 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:40:00.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:40:00.377 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:40:30.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:40:30.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:40:30.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:41:00.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:41:00.817 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:41:00.820 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:41:31.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:41:31.037 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:41:31.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:42:01.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:42:01.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:42:01.263 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:42:31.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:42:31.455 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:42:31.458 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:43:01.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:43:01.604 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:43:01.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:43:31.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:43:31.834 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:43:31.838 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:44:01.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:44:01.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:44:01.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:44:32.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:44:32.226 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:44:32.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:45:02.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:45:02.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:45:02.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:45:32.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:45:32.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:45:32.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:46:02.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:46:02.852 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:46:02.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:46:32.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:46:33.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:46:33.004 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:47:03.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:47:03.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:47:03.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:47:33.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:47:33.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:47:33.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:48:03.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:48:03.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:48:03.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:48:33.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:48:33.810 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:48:33.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:49:04.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:49:04.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:49:04.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:49:34.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:49:34.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:49:34.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:50:04.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:50:04.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:50:04.497 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:50:34.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:50:34.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:50:34.708 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:51:04.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:51:04.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:51:04.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:51:35.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:51:35.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:51:35.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:52:05.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:52:05.293 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:52:05.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:52:35.495 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:52:35.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:52:35.501 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:53:05.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:53:05.643 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:53:05.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:53:35.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:53:35.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:53:35.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:54:05.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:54:05.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:54:05.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:54:36.098 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:54:36.102 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:54:36.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:55:06.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:55:06.315 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:55:06.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:55:36.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:55:36.461 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:55:36.464 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:56:06.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:56:06.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:56:06.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:56:36.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:56:36.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:56:36.902 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:57:07.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:57:07.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:57:07.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:57:37.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:57:37.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:57:37.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:58:07.411 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:58:07.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:58:07.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:58:37.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:58:37.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:58:37.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:59:07.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:59:07.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:59:07.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:59:38.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:59:38.087 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T19:59:38.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:00:08.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:00:08.246 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:00:08.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:00:38.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:00:38.473 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:00:38.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:01:08.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:01:08.711 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:01:08.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:01:39.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:01:39.151 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:01:39.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:02:09.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:02:09.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:02:09.372 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:02:39.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:02:39.582 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:02:39.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:03:09.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:03:09.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:03:09.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:03:40.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:03:40.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:03:40.008 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:04:10.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:04:10.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:04:10.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:04:40.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:04:40.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:04:40.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:05:10.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:05:10.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:05:10.479 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:05:40.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:05:40.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:05:40.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:06:10.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:06:10.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:06:10.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:06:41.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:06:41.109 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:06:41.112 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:07:11.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:07:11.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:07:11.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:07:41.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:07:41.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:07:41.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:08:11.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:08:11.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:08:11.571 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:08:41.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:08:41.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:08:41.789 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:09:11.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:09:12.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:09:12.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:09:42.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:09:42.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:09:42.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:10:12.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:10:12.444 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:10:12.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:10:42.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:10:42.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:10:42.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:11:12.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:11:12.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:11:12.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:11:43.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:11:43.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:11:43.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:12:13.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:12:13.237 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:12:13.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:12:43.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:12:43.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:12:43.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:13:13.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:13:13.856 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:13:13.858 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:13:44.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:13:44.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:13:44.035 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:14:14.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:14:14.185 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:14:14.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:14:44.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:14:44.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:14:44.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:15:14.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:15:14.478 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:15:14.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:15:44.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:15:44.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:15:44.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:16:14.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:16:14.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:16:14.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:16:45.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:16:45.010 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:16:45.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:17:15.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:17:15.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:17:15.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:17:45.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:17:45.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:17:45.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:18:15.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:18:15.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:18:15.468 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:18:45.609 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:18:45.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:18:45.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:19:15.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:19:15.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:19:15.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:19:45.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:19:45.980 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:19:45.982 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:20:16.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:20:16.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:20:16.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:20:46.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:20:46.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:20:46.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:21:16.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:21:16.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:21:16.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:21:46.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:21:46.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:21:46.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:22:16.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:22:16.930 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:22:16.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:22:47.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:22:47.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:22:47.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:23:17.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:23:17.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:23:17.237 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:23:47.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:23:47.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:23:47.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:24:17.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:24:17.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:24:17.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:24:47.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:24:47.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:24:47.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:25:17.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:25:17.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:25:17.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:25:48.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:25:48.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:25:48.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:26:18.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:26:18.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:26:18.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:26:48.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:26:48.444 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:26:48.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:27:18.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:27:18.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:27:18.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:27:48.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:27:48.796 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:27:48.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:28:18.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:28:18.959 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:28:18.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:28:49.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:28:49.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:28:49.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:29:19.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:29:19.351 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:29:19.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:29:49.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:29:49.523 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:29:49.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:30:19.688 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:30:19.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:30:19.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:30:49.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:30:49.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:30:49.944 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:31:20.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:31:20.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:31:20.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:31:50.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:31:50.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:31:50.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:32:20.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:32:20.507 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:32:20.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:32:50.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:32:50.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:32:50.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:33:20.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:33:20.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:33:20.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:33:50.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:33:50.955 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:33:50.958 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:34:21.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:34:21.110 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:34:21.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:34:51.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:34:51.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:34:51.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:35:21.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:35:21.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:35:21.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:35:51.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:35:51.601 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:35:51.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:36:22.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:36:22.045 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:36:22.049 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:36:52.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:36:52.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:36:52.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:37:22.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:37:22.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:37:22.357 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:37:52.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:37:52.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:37:52.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:38:22.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:38:22.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:38:22.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:38:53.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:38:53.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:38:53.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:39:23.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:39:23.173 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:39:23.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:39:53.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:39:53.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:39:53.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:40:23.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:40:23.549 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:40:23.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:40:53.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:40:53.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:40:53.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:41:23.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:41:23.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:41:23.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:41:54.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:41:54.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:41:54.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:42:24.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:42:24.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:42:24.214 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:42:54.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:42:54.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:42:54.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:43:24.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:43:24.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:43:24.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:43:54.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:43:54.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:43:54.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:44:24.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:44:24.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:44:24.923 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:44:55.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:44:55.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:44:55.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:45:25.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:45:25.245 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:45:25.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:45:55.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:45:55.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:45:55.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:46:25.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:46:25.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:46:25.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:46:55.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:46:55.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:46:55.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:47:26.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:47:26.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:47:26.022 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:47:56.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:47:56.178 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:47:56.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:48:26.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:48:26.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:48:26.551 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:48:56.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:48:56.768 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:48:56.771 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:49:26.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:49:26.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:49:26.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:49:57.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:49:57.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:49:57.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:50:27.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:50:27.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:50:27.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:50:57.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:50:57.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:50:57.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:51:27.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:51:27.867 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:51:27.869 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:51:58.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:51:58.022 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:51:58.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:52:28.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:52:28.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:52:28.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:52:58.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:52:58.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:52:58.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:53:28.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:53:28.506 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:53:28.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:53:58.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:53:58.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:53:58.668 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:54:28.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:54:28.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:54:28.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:54:59.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:54:59.088 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:54:59.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:55:29.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:55:29.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:55:29.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:55:59.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:55:59.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:55:59.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:56:29.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:56:29.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:56:29.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:56:59.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:56:59.796 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:56:59.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:57:29.954 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:57:29.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:57:29.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:58:00.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:58:00.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:58:00.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:58:30.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:58:30.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:58:30.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:59:00.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:59:00.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:59:00.578 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:59:30.808 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:59:30.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T20:59:30.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:00:01.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:00:01.048 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:00:01.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:00:31.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:00:31.278 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:00:31.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:01:01.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:01:01.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:01:01.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:01:31.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:01:31.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:01:31.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:02:01.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:02:01.870 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:02:01.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:02:32.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:02:32.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:02:32.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:03:02.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:03:02.238 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:03:02.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:03:32.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:03:32.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:03:32.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:04:02.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:04:02.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:04:02.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:04:32.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:04:32.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:04:32.768 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:05:02.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:05:02.916 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:05:02.918 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:05:33.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:05:33.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:05:33.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:06:03.289 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:06:03.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:06:03.294 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:06:33.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:06:33.556 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:06:33.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:07:03.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:07:03.802 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:07:03.804 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:07:34.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:07:34.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:07:34.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:08:04.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:08:04.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:08:04.176 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:08:34.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:08:34.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:08:34.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:09:04.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:09:04.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:09:04.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:09:34.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:09:34.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:09:34.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:10:04.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:10:04.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:10:04.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:10:35.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:10:35.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:10:35.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:11:05.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:11:05.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:11:05.440 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:11:35.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:11:35.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:11:35.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:12:05.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:12:05.963 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:12:05.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:12:36.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:12:36.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:12:36.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:13:06.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:13:06.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:13:06.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:13:36.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:13:36.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:13:36.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:14:06.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:14:06.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:14:06.594 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:14:36.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:14:36.755 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:14:36.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:15:06.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:15:06.910 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:15:06.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:15:37.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:15:37.133 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:15:37.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:16:07.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:16:07.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:16:07.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:16:37.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:16:37.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:16:37.513 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:17:07.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:17:07.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:17:07.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:17:37.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:17:37.838 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:17:37.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:18:08.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:18:08.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:18:08.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:18:38.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:18:38.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:18:38.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:19:08.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:19:08.496 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:19:08.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:19:38.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:19:38.649 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:19:38.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:20:08.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:20:08.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:20:08.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:20:39.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:20:39.020 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:20:39.022 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:21:09.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:21:09.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:21:09.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:21:39.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:21:39.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:21:39.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:22:09.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:22:09.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:22:09.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:22:39.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:22:39.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:22:39.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:23:10.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:23:10.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:23:10.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:23:40.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:23:40.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:23:40.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:24:10.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:24:10.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:24:10.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:24:40.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:24:40.765 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:24:40.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T21:25:09.933 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-08-25T21:25:09.934 DEBUG:teuthology.task.console_log:Killing console logger for smithi089 2023-08-25T21:25:09.934 DEBUG:teuthology.task.console_log:Killing console logger for smithi121 2023-08-25T21:25:09.935 DEBUG:teuthology.task.console_log:Killing console logger for smithi149 2023-08-25T21:25:09.935 DEBUG:teuthology.exit:Finished running handlers